Your perspective Arbuckle, seems to be coming from someone who does not use a computer on a regular basis in the home. It's cool that you are considering the PC option.
I would hazard a guess that most folks who use a PC as their "transport/front end/server" already had a computer in their home and expanded its use to include music playback. Obviously the cost would be $0 to start. An external DAC can be added depending on preference, but many do that with a stand alone CD player as well. Starting from scratch, a Mac mini is an option at $500 new or about $350 used. They are very quiet. Yes, a display is needed for setup and burning. Some automation can happen without screen and keyboard, by using a remote (ipod or other).
What are you missing? It's a different approach to collecting and listening to music. Sure it has it own set of challenges. To me, it is sort of like comparing a typewriter to a computer for writing letters. They both output the same page of text. but what you can do with the content, and pages is quite different from a macro perspective.
If one listens to 2 albums per day maybe a computer is not for them. A stand alone media player would make more sense.
Control and flexiblity.
The main benefits of PC audio are control over the music playback order.
If you like to listen to public radio from Boston (while you are in Colorado), create an infinite number of playback list of songs your choosing, archive music (thousands of CDs) in one location, PC audio will do that - plus some.
I don't include downloaded music (online music stores) as a variable in the comparison since there is no equivalent compatible for all standalone players. It could be looked at as an inexpensive trial of music from an artist/album, prior to purchasing the vinyl or disc media.
I went head first last year into digitizing 500 CDs and setting up my Mac based music server. It's been fun and provides great convenience and wonderful sound. I started with my existing home computer and added a DAC. Though, I have the advantage of having the computer in an adjacent room to the living room, and use a remote to control playback. All my CDs are in a back closet.