First find the sound you like. No point trying to get great analogue sound if you crave digititis. Then allocate by bang per buck. And then, what @almarg said.
You may find that some things give precious little bang for buck in the system you are envisioning. Scrub them until you've optimized everything which gives more value. Start by scrubbing cables or power cords or fuses that cost more than a few bucks. When you have upgraded all those caps to styrene or teflon, all those resistors to nude Vishays, that cartridge to a stone body Koetsu, then, and only then, maybe.
IMO. YMMV.
You may find that some things give precious little bang for buck in the system you are envisioning. Scrub them until you've optimized everything which gives more value. Start by scrubbing cables or power cords or fuses that cost more than a few bucks. When you have upgraded all those caps to styrene or teflon, all those resistors to nude Vishays, that cartridge to a stone body Koetsu, then, and only then, maybe.
IMO. YMMV.