Intuitively the answer is Yes. However, in practice in ain't necessarily so I've found. My Wadia 6i will drive the ARC VT100 direct but I can truly detect no difference if I insert the ARC Ref 2. As a purist I wanted it to be better but I can't honestly say it was.
Maybe it boils down to the quality of the CD output stage?
Anyway, no rules or opinions can replace YOUR ear. If you like it that way - listen to it that way.