It is not worth it to go to CES, but no for the reasons that you suppose.
I have been to CES once, and that was enough. There seems to be a lot more ego there and a lot less fun. I have been to RMAF twice and would still do that again before going back to Lost Wages for the CES show.
RMAF people are more friendly, and helpful. They know that for the most part they are dealing with hobbiests, not dealers who have to book $50,000 orders.
The main show at CES is waste of time for most people. Static displays, of big $$$ gear, or lots of TV and video. Everyone knows that audiophiles don't care about video!!! Alexis Park and the San Tropez are where the fun stuff is, even though a lot of people never even walk next door to check out THE Show.
Unless you live in Lost Wages, don't waste your time, go to Denver and have a good time. No you won't find every last dealer in Denver. There might be more is Vegas, but companies like Krell were just showing gear, not auditioning it.