I asked Roger Modjeski (Ram Labs, Music Reference) about this, and he said the idea that you should not use your hands is a myth, he then explained to me why, but I don't remember his rational).
It's called audiophile paranoia. Seriously, what possible harm could come from getting bodily oils on the outside of a GLASS tube? I suppose that constant handling of the pins could cause them to tarnish a bit, but most are tarnished anyway, especially on NOS tubes. Just make sure the tube is cool, use your hand and pull it out. Wipe it off afterward if you don't like the fingerprints.