A Question About Reviewer Techniques


I've been reading the audio rags since the mid-80's and continue to subscribe (albeit with much less enthusiasm) to TAS and Stereophile while also reading the online publications occasionally. I've always wondered why reviewers do not evaluate products in systems recommended by the manufacturers. For example, a recent review of a loudspeaker has generated some controversy because the journals main review system uses speaker cable from a national hardware chain. I'm not criticizing the use of these cables (haven't heard them) but rather the decision to evaluate a particular product (in this case loudspeakers) using cables that are not recommended by the speaker manufacturer. Why don't the review mags simply ask the manufacturer what cables, electronics and source materials will bring out the best in their products and then make an effort to evaluate the product using these components? Any novice knows that system synergy is vitally important in obtaining good sound but somehow this core principal is thrown out the window (for the sake of expediency?) by reviewers who simply pair products under evaluation with whatever happens to be lying around their listening room or with whatever works with their other components. Then they write a review which is somehow supposed to be "authoritative" but which may not show the product in the best possible light. Anyone else find this a little troubling?
dodgealum
IMO, the key is for the reviewer to have a consistent system that they are very familiar with, so when the reviewed component or speakers are placed into the system, the reviewer can accurately describe the sonic result, and also make comparisons with other similar equipment they have heard in the same system. The reviewer should also describe any anomalies with the system or room and how those impact the review.

What I would have issue with is, if a reviewer were to place equipment in a system that does not match electrically (e.g., impedance mismatches) or if the review rig in general is not well-suited for the equipment being reviewed, such as reviewing a Krell amp (known for world class bass) with small monitor speakers (known for limited bass below 60hz); or reviewing large speakers, made to produce high spl's in large rooms with an extended powerful bass response, and putting them in a small room. Duh, no wonder it doesn't sound good. I think the wire is small potatoes as long as the reviewer is familiar with their system, and as long as the impedances, efficiencies, room and system characteristics are appropriate for the equipment under review.

Finally, no review is the final word, but simply a subjective opinion based on the reviewer's experience with other equipment and listening preferences.
Raquel, what I was trying to convey is that once you have your measurements, you still have to walk through the wonderland of equipment and attempt to put together a synergistic system. The measurements are a starting point and there will be many choices that should be "right" because the specs say so, but they don't guarantee a synergistic system. The point about the $20,000 cables on the $2,000 speakers was meant to be absurd!
>> The point about the $20,000 cables on the $2,000 speakers was meant to be absurd!<<

A terrific point but unfortunately these situations exist. Look at systems such as joeyboynj who has a very average set of components and thousands of dollars in cables.

This occurs more than you imagine.