While the pursuit of audio (musical) satisfaction certainly has its ups and downs, putting together the right system for yourself can be done, and without spending insane amounts of hard-earned cash.
A system consisting of some vintage, and some newer gear, can be inordinately musical and satisfying. If you throw in the towel, you'll never experience the blessing of enjoying music as you would like to have it, in your home on a daily basis.
Many of us have found high-sensitivity speakers/low power SET amps to be just what we were looking for all along. You don't state what you have at this time that is distressing you, but try listening to such a system, and see if you might find what you've been missing.
Another thing worth mentioning, is on this forum, there is a wealth of knowledge possesed among its members, along with the usual dose of crackpots you'll find on any forum.
Point being, members have helped immensely in finding the right set up for me. Avail yourself to this treasure trove, many knowledgeable members enjoy helping those of us that just don't know as much as they would like.
Good luck, sounds like you could use some about now.
Dan