Budget of $15-20K? You should not even be thinking twice about this! With a budget like that you will be able to procure a transducer which would walk all over the Osprey's performance. It's a simple matter of what you get for the money. The osprey may be very nice, but it's obviously limited much more so than a great number of $15-20K speakers. You can get into an entirely different class of performance. This is one of the questions that the obvious answer is yes, make the move.
With a budget like that you also should consider whether you want a panel speaker. Completely different world with a big panel as opposed to a smaller tower like the Osprey. You have a LOT of room to move upward in performance no matter which direction you go, and it seems you have the motivation and means. It would be a shame for you to get stuck with a smallish tower and never get a slice of the experience of a larger, more capable tower.
With a budget like that you also should consider whether you want a panel speaker. Completely different world with a big panel as opposed to a smaller tower like the Osprey. You have a LOT of room to move upward in performance no matter which direction you go, and it seems you have the motivation and means. It would be a shame for you to get stuck with a smallish tower and never get a slice of the experience of a larger, more capable tower.