No that will happen if there is no cart. You shouldn't be turning it on without a cart in it anyway.
So if the contacts are dirty and no cart is inserted this is common? Ive never got anything similar with my other working 2600s when Ive started them without a cart before. The first thing I did when I noticed that it didn't wanna work as it was supposed to was that I cleaned the contacts and the pcb. Ill clean the the contacts some more just to be sure though.