It is good to note that passives come in different flavors. I am not a technical expert in this, but a transformer volume control - TVC - I understand will generally work better and in more instances then just a resistive attenuated volume control in both impedance matching and for a fuller sound.
As I've said, with my TVC I don't lack any dynamics -- everything is as 'colorful' as it was with the few active pre's I've had, with the added benefit of more transparency and air between sounds. Bass is low and tight, highs are extended and detailed. Soundstage is better defined.
Another option is an active/passive pre in the same unit. Wyred 4 Sound, Placette and others make such pieces.