Entirely speaker- and room-dependent, in my experience. Not the same speakers, but my Wilson Benesch Arcs sound the same, grills on or off, so I leave them on for protection. On the other hand, the grills on my BMC Purevox can have a bit of a blanketing effect on the sound so removing them definitely affects the sound. Go with what works, to your ears, in your room.