Rega P25, would it sound better than my CDP?

Hard to tell. Probably if you use a good phono preamp and set up the turntable properly. I've found for equal dollars spent, vinyl sound better.

CD's are generally quieter if that matters to you (no pops, scratches, etc). Invest is a good record cleaning system.

But then of course not all CD recordings are available on vinyl, and not all vinyl is available on CD. So you may find you need both.

If you can swing it in your budget get the Rega and keep the Kanday...

"sound better" is a tough call.
Remember it will sound different, and have some noise, much higher maintenance.
I went 'back' to LP again... and can say if you have a good/cheap plentiful supply of used LPs, then it is worth going to LP.
If you have to buy them via the internet...($$$$$$$$$$$)
I would not do it.
I aquired about 10,000 good LPs in about two years just in my local area (and dabbled on eBay for about a hundred LPs.. but not any more.)
As for sound.... I enjoy Lp sound with my Dual 7000 and Shure V15xMR with a Audio Research PH-2, and also listen to Cds.

Better? Not really. With the Rega music will sound sluggish and percussion instruments will not sound crisp and fast. Give it a test: buy a Fania All Stars virgin vinyl limited edition salsa LP (from eBay) and then get the same in CD format. Compare...

***