How much can be measured -- and how much cannot?


There has been a lot of discussion over the years on Audiogon regarding the measurement of components and other audio products. Some people claim everything is either measurable now or will one day become measurable with more sophisticated measuring equipment. But others say there are things in high end audio that will never me measurable and that measurements are really not that important.

Here is a typical example -- a quote taken from the Stereophile forum regarding their review of the Playback Designs MPS-5:

"JA 2/17/10 Review Measurements of Playback Designs MPS-5
Posted: April 13, 2011 - 8:42am

John Atkinson's 2/17/10 review measurements of the Playback Designs MPS-5 revealed less than stellar technical performance even though Michael Fremer really liked the player. I've included JA's closing measurement remarks below followed by the manufacturer's comments.

To my knowledge there was never any followup in Stereophile regarding the manufacturers reply the MPS-5 could not be adequately measured with traditional measurement techniques.

I believe Stereophile should respond to this reply in the interests of its own measurements credibility.

Len"

How important do you think measurements are? Are the ears really the only true arbiter?
sabai
I second Mapman's comments. As I see it the main usefulness of measurements, and also specifications, is that they allow one to identify and RULE OUT candidates for purchase that would be poor matches to either the rest of the system (e.g., impedance incompatibilities, gain and sensitivity mismatches, etc.) or to the user's requirements (e.g., maximum volume capability, deep bass extension, etc.).

Also, they can facilitate diagnosis of issues that may exist with components that have already been purchased, but that may not be optimally matched to the rest of the system.

The number of times that I and many others have referred to John Atkinson's measurements in helping Audiogon members to make purchase decisions or to diagnose problems is practically countless.

A secondary benefit is that measurements and specifications can help to provide a better understanding of the design concepts and approaches that underlie a product, which is something that I always prefer to have.

Regards,
-- Al
Measurements are a beginning but they are not the end of the journey. It gives an idea of what the piece will do or can do then you have to figure out how that works with what you have and or are willing to acquire to make it work for you.
Emotions and logic are two different contexts. Perhaps both are needed to fully evaluate and appreciate equipment and systems. For music, the final evaluation is how much is emotionally moving to the listener. One can ask, "do I hear detail, staging, extension, depth and evenness of frequency response," but in the end, whether any of these characteristics is emotionally involving is the ultimate question and challenge, and for that, to my knowledge, no quantitative measurement has been, so far, predictive.
The froofaraw around stuff you cannot measure?
The problem YES there are qualities no one has figured out how to measure. But NO the problem is others abuse this to make rediculous claims no one can podssibly verify realistically.
So we get all sorts of crazy advertising drivel of Quantuum tunneling, and various 'new age' sort ofdrivel to 'explain' whey one item (which looks just like the $10 one) should cost $1,500. instead.

So it really thee FACT some stuff cannot be measured which is important. and then the fact other abuse that first fact to obfuscate issues and sell 'tin plated junk' as is it were gold.

And that bunch of folks pushing to line with bs are the ones I blame.
So all in all yeah i find there are real things which measurements cannot quantify.
On the other side are all sorts of bogus balony being
spouted claming improved sound but no one can show that particualr stuff IS crap due to the aformentioned hustlers being able to pull the "can't be measured card"
So I hope all those con artists (even the one's who seem to actually believe thier own BS) will end up in a Hell of thier own creation.
As PT barnum said: a Sucker is born every minute. In the Audiophile world.. same comment.

I go for plenty of tweaks. so i guess i try to walk a line between folly and science
"The number of times that I and many others have referred to John Atkinson's measurements in helping Audiogon members to make purchase decisions or to diagnose problems is practically countless."
Actually I have never found measurements to help me in any audio decision to by a certain product. Measurements are helpful in the design process but do not tell you anything how a component will sound. Use your ears and they will guide you on the right path