|
General Asylum General audio topics that don't fit into specific categories. |
|
|
|
General Asylum General audio topics that don't fit into specific categories. |
|
In Reply to: Why blind listening tests are crucial posted by 3db on March 26, 2015 at 09:12:05:
Bottom line:
All it takes is a crappy blind test, for it to come up statistically non-significant.
This proves absolutely nothing.
Of course, often times a null result of a blind test is confused as being the same as a negative result, but that is just not true, and not real science.
The second most problematic issue is that it is really hard to design and maintain a truly high resolution blind test that can actually detect subtle sonic differences. It is much harder than most people realize, especially if you have never done it before.
Unless the blind listening test has met a certain metric of sensitivity, that is, it has shown exactly what it CAN detect, then for all we know, it is inherently incapable of detecting the sonic difference in which we are interested in investigating. Unless it has met that baseline metric with statistical proof of it's detection abilities, it is indeed worthless and useless as any sort of detection system or proof of any sort of lack of sonic differences.
These posts below relate to this subject, and go into more detail on what the problems and issues with blind testing are, and why they may not be the be-all, end-all that some folks seem to think they are.
Yes, we can fool ourselves, but it is a fact that this extends to reading more than we should into a blind listening test null result too, that is also fooling ourselves (all in the name of supposed science).
http://www.audioasylum.com/forums/prophead/messages/2190.html
http://www.audioasylum.com/forums/prophead/messages/2579.html
http://www.audioasylum.com/forums/prophead/messages/2580.html
http://www.AudioAsylum.com/forums/prophead/messages/3100.html
Jon Risch
This post is made possible by the generous support of people like you and our sponsors:
Follow Ups
- RE: Why blind listening tests are worthless - Jon Risch 22:04:19 03/30/15 (0)
Top of Page ]
[ Contact Us ]
[ Support/Wish List ]
[ Copyright © 2024, Audio Asylum, all rights reserved ]
