Home Tweakers' Asylum

Tweaks for systems, rooms and Do It Yourself (DIY) help. FAQ.

Why is testing so divisive?

Many associate A/B testing with rapid switching but would prefer long(er) evaluation periods. I think everyone should find a testing period that suits them - rapid or slow. But, IMHO, good testing should be unsighted because knowing what you are listening to undoubtedly influences the result.'Double blind' is a rigorous sub-set of unsighted testing that seems to be a pejorative term among subjectivists. It is probably impossible to achieve unsighted testing for long(er) evaluation periods and likely only practical under controlled A/B or A/B/X testing. People don't like the pressure of A/B testing and conflate it with the unsighted aspect. Regarding objectivists and subjectivists I think the underlying question is of expectation bias. If you expect to hear no difference then you probably won't hear one under any circumstances. If you do expect to hear a difference then unsighted testing is the best way to prove a difference is heard and not seen.

Regards
13DoW


This post is made possible by the generous support of people like you and our sponsors:
  Kimber Kable  


Follow Ups Full Thread
Follow Ups

FAQ

Post a Message!

Forgot Password?
Moniker (Username):
Password (Optional):
  Remember my Moniker & Password  (What's this?)    Eat Me
E-Mail (Optional):
Subject:
Message:   (Posts are subject to Content Rules)
Optional Link URL:
Optional Link Title:
Optional Image URL:
Upload Image:
E-mail Replies:  Automagically notify you when someone responds.