Popping Sound From TT

It seems every time I remove a record from the platter there is a loud popping noise coming from the speakers. At first it was not too bad but now that I have upgraded my phone pre amp, it's louder and I’m afraid that I can blow a speaker, if I don’t remember to lower the volume or change inputs. Like I said this only happens when I remove the record. In fact I can just wave the record around the turn table and still get this popping.