2. cables
  3. 1039633192

Why is Double Blind Testing Controversial?

I noticed that the concept of "double blind testing" of cables is a controversial topic. Why? A/B switching seems like the only definitive way of determining how one cable compares to another, or any other component such as speakers, for example. While A/B testing (and particularly double blind testing, where you don't know which cable is A or B) does not show the long term listenability of a cable or other component, it does show the specific and immediate differences between the two. It shows the differences, if at all, how slight they are, how important, etc. It seems obvious that without knowing which cable you are listening to, you eliminate bias and preconceived notions as well. So, why is this a controversial notion?
moto_man
onhwy61's avatar
onhwy61
4,163 posts
 
Sean, I always thought one of the key features of a true DBT is that the subject does not know the nature of variable element. When applied to audio the listener should not know what to listen for.

I find it interesting that both sides of this issue are strongly suspicious of the motives of the other side. It seems that the interpretation of the results are more controversial than the actual DBT itself.
sean
6,229 posts
 
Those that are administering the tests do not know what is being tested at the very specific time of the DBT, but that does not mean that there isn't some type of log or record that couldn't be taken of such an event by an outside source such as a computer, etc.. Sean
>
ozfly
887 posts
 
Onhwy61 -- it is specifically the motivations that yield the controversy. A DBT could, with great effort, be designed to yield reasonably valid results. The posts above suggest that such effort is seldom made because the test sponsors don't understand or believe that effort is required. Without going through all that work, the test becomes a "double deaf test" as Unsound suggests.
onhwy61's avatar
onhwy61
4,163 posts
 
A true double blind test wouldn't be easy to set up, but as a scientific experiment it really isn't very hard. As far as interpreting the results of an experiment goes, I don't think you can design an experiment that isn't open to misinterpretation. It's a very different statement and attitude to say that a DBT has to be well designed and rigorous than to say DBTs serve no useful purpose.
seandtaylor99
1,262 posts
 
I have a proposal ... double blind posting. Audiogon allows us to post our views with anonymity. Other Agoners then guess who posted which post, according to the content of the post, and the (extreme) opinions therein.
Suggestions for starter threads : "Power cords make no difference" and "SACD is killing digital".
More to discover