Tweakers' Asylum Tweaks for systems, rooms and Do It Yourself (DIY) help. FAQ. |
|
In Reply to: RE: The subject of A/B testing... posted by Duster on November 10, 2020 at 08:10:00:
Many associate A/B testing with rapid switching but would prefer long(er) evaluation periods. I think everyone should find a testing period that suits them - rapid or slow. But, IMHO, good testing should be unsighted because knowing what you are listening to undoubtedly influences the result.'Double blind' is a rigorous sub-set of unsighted testing that seems to be a pejorative term among subjectivists. It is probably impossible to achieve unsighted testing for long(er) evaluation periods and likely only practical under controlled A/B or A/B/X testing. People don't like the pressure of A/B testing and conflate it with the unsighted aspect. Regarding objectivists and subjectivists I think the underlying question is of expectation bias. If you expect to hear no difference then you probably won't hear one under any circumstances. If you do expect to hear a difference then unsighted testing is the best way to prove a difference is heard and not seen.
Regards
13DoW
This post is made possible by the generous support of people like you and our sponsors:
Follow Ups
- Why is testing so divisive? - 13th Duke of Wymbourne 12:57:23 11/10/20 (2)
- "It is probably impossible to achieve unsighted testing for long(er) evaluation periods" - Tre' 06:46:12 12/18/20 (1)
- RE: "It is probably impossible to achieve unsighted testing for long(er) evaluation periods" - Duster 01:51:21 12/29/20 (0)