Yep you only know a good speaker for sure when you hear it and each speaker has to be setup properly (including a proper amp) to enable that. Speaker A might handily sound good and Speaker B not on Amp A but swap in amp B and the reverse is very possible.
Also it is true that if the speaker is an easy load to drive, chances are it will sound good off a wider variety of amps than otherwise.
A good example is KEF ls50. State of the art within its limits in many ways, but will not sound good if amp is not up to the task of driving them ie lots of clean not just power but also current. I’ve heard both cases in my house.
Compare to Fritz Carrera, designed to provide a very easy load to drive. . I heard these sound very good indeed off a 7 watt headphone amp recently and have no doubt they would excel with most any amp used.
Also it is true that if the speaker is an easy load to drive, chances are it will sound good off a wider variety of amps than otherwise.
A good example is KEF ls50. State of the art within its limits in many ways, but will not sound good if amp is not up to the task of driving them ie lots of clean not just power but also current. I’ve heard both cases in my house.
Compare to Fritz Carrera, designed to provide a very easy load to drive. . I heard these sound very good indeed off a 7 watt headphone amp recently and have no doubt they would excel with most any amp used.

