What is the ideal volume setting?


As every CD seems vary in terms of maximum and minimum loudness, I find that I have to play a good ways into a disc before I find the ideal volume dial setting to get the most out of the music. This is very disconcerting as I usually have to start the disc all over after I find the best setting.  I wonder if anyone else experiences this.
I listen mostly to classical.  I don’t know if the same applies to other types of music. 
rvpiano
I find there is an ideal volume level where everything sounds as it does in a concert hall.  Every classical recording is different in that regard.
it isn’t so much that I can’t hear detail at a lower setting. I can.
There’s just an optimum level where everything sounds “right.”
I have modified Dalquist DQ 20 speakers, NuForce monoblock amplifiers, along with a CJ preamp.
Thanks for the explanation; I understand.  I suppose it would be nice if levels were standardized on discs, but.....Do you always sit at the same distance from orchestras when in concert halls?  Be careful what you wish for.  Classical recordings are deliberately recorded with different perspectives; some to give a close to the orchestra perspective and some further back.  For concert hall realism, it seems to me one would have to adjust the volume for each recording anyway since the recording with a close-to-orchestra perspective would have to be listened to louder than one recorded further back for it to sound "correct".  
@jaybe 
Ah yes! The right answer!

Who is it that calls that knob "pleasure"? I'm doing that with the pre-amp I build. I like it loud enough that I worry my neighbors will call the cops. So far not one complaint!