Are high sample rates making your music sound worse?

The notion that we may be overdoing it has always been at the back of my mind. 

I've found that up sampling to 96 kHz has never presented an issue but that above 96 kHz has and that includes recently recorded material.
A friend however gave me a CD of 'Ziggy Stardust' that was originally a MOFI JVC vinyl pressing and the higher the up sampling that I could go, the better.

@goofyfoot 



It stands to reason that if you upsample but have same bit rate as music was initially recorded at you would in essence kind of thin out the track altered.....losing possibly bass or bottom end...

ishkabibil, I wouldn't try refuting that claim but I haven't necessarily noticed that with my equipment; Ayre QB9 DSD DAC, ASR Emitter II Exclusive amp, Quad 2905 ESL's.
As I said, most anything above 96 kHz sounds wrong but in nearly every case, setting the PCM at 96 kHz sounds dead on where it should be.
It is most likely precarious by what type of equipment is being used. Various DAC filters and the like may determine whether or not up sampling is even a good idea.