If you don’t want to buy used, look for a well made value priced table with a good cartridge. For example the Marantz TT 15S1 can be had for $1,499 and it comes with a Clearaudio Virtuoso ($800) cartridge. Clearaudio also makes the turntable for Marantz. It’s solid.
You have a number of options for a phono stage in the $500 range. Others can better provide advice for the phono stage. There’s your $2,000 spend and this would work well.