"why do I hear this and no one else does, or if they do why doesn't it bother them?"Because most speakers are incapable of accurate phase response, the vast majority of people have never heard a minimum phase error system.
Manufacturers and sales people prattle on about frequency response, XOver order and other irrelevant attributes.
There isn't a system in a hundred that can accurately image a DI bass or align a kick point and heft. The 'image' presented is a nebulous bucket of mush.
Some eat at McDonald's. Others prefer to go hungry.

