I suspect the same could be said among audiophiles. In my brief time as an "audiophile" I have found that some tweaks, recordings, systems make a big difference just as described by other audiophiles while others make no difference whatsoever. I have no way of knowing if that is just inexperience or how my perception is wired.....and we all have to remember, hearing is not just an acuity issue. There is no 'hearing' without processing in the brain.
There is an extreme visual analogy of this:
Certain types of brain pathology can lead to someone with normal eyes not being able to see. In this specific condition they are essentially blind because the eye is not connected to the visual centers of the brain even though the eye itself is perfect. Sometimes, however, a reflex tract will be preserved. When this is the case, the person is blind but if you throw something at them they will duck.

