In Reply to: It's the essence of the DBT that you don't understand posted by Commuteman on December 21, 2004 at 21:29:16:
You have tried to attribute to me the position that cables make no difference. Indeed, I could point out DBTs which show that some of them do--about 30 foot lengths of 16 and 24 gauge cables, I think--but this apparently makes no difference to you.
I should also comment that whether I or anyone else believes that, this does nothing to establish when and under what conditions differences are audible. So, your argument is irrelevant.
Whether you actually spend more than a few dollars for interconnects or more than $.30 a foot or so for speaker cables is also irrelevant. It's your choice.
"The mechanical activity of using an ABX test on interconnects is indeed easy; designing a real DBT that actually mimics the normal use of the interconnect, and introduces NO other variables, is not."
You have not shown that any relevant variables are changed. A person using an ABX machine can do so at home using their own system, at their own leisure. They can switch between the known A and B as often as they want (the user controls the switching), they can compare them to the unknown X as often as they want, and they can decide when to choose whether X is A or B. This is exactly what happens with sighted auditioning except the switching is probably much faster.
According to jj, sometimes the statistics will show that subjects can differentiate a difference close to the JNDs when they thought they were guessing. But they actually were not guessing. So, people can sometimes detect differences below conscious awareness in a DBT. That's how sensitive a DBT is. I mention this because I suspect you think detecting a difference is necessarily conscious.
"In every other use of blind testing (at least those of which I am aware), the thing being tested is used in its intended, normal application. The user is unaware whether they are using the test item or not, thus eliminating the possiblity of bias. A placebo is used to provide a reference (and provide two sample sets for comparison).
Oh. So you want the subject to differentiate between A and a placebo! Well, let's call the placebo B. GMAB In any case, the use of the ABX switcher can be as close to normal use as desired. And as for not being aware which item is being used, that's exactly what the ABX box does. You are not making sense here.
"In the case of ABX audio testing, the test DOES NOT mimic real world usage, and the outcomes are not defined the same way. The ABX test requires that the test subjects identify differences. "
If the person can determine better or worse, this implies they can differentiate. Again, you are not making sense.
"I contend that there is no proof that this activity is the same, or even uses the same brain functions, as listening to music."
Ay there's the rub! As I have said, if you think there is a relevant difference, then it is up to you to show it. One cannot prove two things are the same--just as one cannot prove two wires, two amps, two CDPs are audibly the same. For some reason, you forget this little bit of logic when you try to make your case.
"We can't measure the emotional response to audio equipment directly, so we have tried to use listening tests as a substitute. IMO, the burden on proof is on the advocates of such tests to PROVE that they adequately mimic the real thing. To the best of my knowledge, that has never been demonstrated."
No, the burden of proof is on those who maintain there is a difference. I don't know why people find that so difficult to grasp. You reference to emotional response is a red herring. If someone has a different emotional response to two things, that means they can differentiate them. They would be able to differentiate them in sighted listening, but that introduces those extra variables you worry about above.
I mean you say someone might react differently to the sound of two components but then you turn around and deny this is a difference! This is not coherent, man!
DBT is not itself a measurement.
"So, IMO, the ABX tests proposed so far fail on 2 counts: they measure the wrong thing (detectability vs. quality), and they measure it under the wrong conditions (listening for differences vs. listening to music)."
"Can anyone prove me wrong?"
I just have. DBT is not a measurement. As for detectability vs. quality, differentiating the quality implies detecting a difference. If you don't think one can do DBTs for listener preferences, I suggest you look a the White Papers on the Harman International Site.
As for listening for differences as opposed to listening to music, you suggest a difference but offer no evidence; the burden of proof is on those who assert a difference. Does it make any difference to the results of a DBT? Part of this I suspect is that you do not consider the way you react as showing a difference, which is not coherent.
"As to my second point: I can only reiterate that, since the current state of play is an absence of absolute proof either way, your requirement that any advice be offered from a position of proof REQUIRES that no advice be given."
There are not too many absolutes in everyday life. Statistics doesn't give them, just probabilities. Here's a quote from the ABX site, linked below. The second part is often quoted, but strangely, the first is not.
"When an individual ABX Comparision is completed, the responses are checked against the key in the ABX Comparator in ANSWER mode. The number of correct responses is compared to the number of response attempts to give a score such as the example of 20 correct out of 30 attempts, which we have written briefly as a fraction or a percentage: 20 / 30 = 67%. The score is then compared with the probability table from which the probability that it is a random score is determined. Thus the result is stated: 20 / 30 = 67% (p = 0.049). This literally means that the score (20/30) is probably not random except for a 0.049 chance that it is random. Thus the result of the experiment is that the null hypothesis is not true except for a 0.049 chance it is true, or in audiophile terms, A sound different from B except for a 4.9% chance that they are the same.
Note that no matter what score is achieved, A = B cannot be proven. That is the ABX Double Blind Comparison can never be used to prove two audio components sound the same. The notion that ABX can prove components sound the same is a common misconception about ABX."
I believe Jeremy Benthan said probability is the guide to life. Indeed, we often give advice on probabilities. To require absolutes is an unreasonable standard. To allocate resources based on probabilities and risk assessment is not.
"Nature loves to hide."
---Heraclitus of Ephesus (trans. Wheelwright)
This post is made possible by the generous support of people like you and our sponsors:
Topic - Double Blind Comparison Tests - JimOfOakCreek 20:13:26 12/18/04 (113)
- The definitive one was published... - mkuller 13:02:18 12/25/04 (1)
- Would like to find that one - Robert Hamel 10:45:06 12/27/04 (0)
- Re: Double Blind Comparison Tests - RGA 14:16:52 12/20/04 (2)
- Re: Double Blind Comparison Tests - firstname.lastname@example.org 09:10:35 12/21/04 (1)
- some good points, and a summation on my part - BS64 13:03:21 12/23/04 (0)
- Re: Double Blind Comparison Tests - Soundmind 05:19:55 12/20/04 (26)
- Re: Double Blind Comparison Tests - Bob Wortman 23:18:30 12/29/04 (0)
- Re: Double Blind Comparison Tests - JimOfOakCreek 08:16:55 12/20/04 (24)
- Have you heard a real high-end system? - Commuteman 10:23:32 12/20/04 (22)
- And the system in the room next door got my vote for best in show... - mkuller 13:09:01 12/25/04 (2)
- Interesting that you should mention that system.... - Commuteman 08:58:20 01/04/05 (1)
- I was in about the... - mkuller 11:37:21 01/04/05 (0)
- Re: Have you heard a real high-end system? - JimOfOakCreek 10:42:18 12/20/04 (18)
- It can be quite a revelation - E-Stat 13:26:17 12/20/04 (0)
- Re: Have you heard a real high-end system? - Soundmind 10:48:39 12/20/04 (16)
- exactly (nt) - Bob Wortman 23:15:43 12/29/04 (0)
- :-) - Commuteman 10:59:46 12/20/04 (14)
- Re: :-) - JimOfOakCreek 11:35:52 12/20/04 (13)
- Re: :-) - Soundmind 12:49:45 12/20/04 (12)
- I didn't say it needs to be expensive.. - Commuteman 14:40:58 12/20/04 (11)
- Goosebump effect - pburant 05:25:22 12/21/04 (10)
- Re: Goosebump effect - Commuteman 08:11:39 12/21/04 (7)
- Are you a musician? (nt) - pburant 10:06:26 12/21/04 (6)
- Not according to anyone who's heard me play....:-) - Commuteman 13:28:33 12/21/04 (5)
- Re: Not according to anyone who's heard me play....:-) - pburant 06:24:42 12/22/04 (4)
- Re: Goosebump effect - Soundmind 06:35:35 12/21/04 (1)
- Depending on your local politics.... - pburant 06:39:52 12/21/04 (0)
- Re: Double Blind Comparison Tests - Soundmind 08:34:19 12/20/04 (0)
- Re: Double Blind Comparison Tests - Jon Risch 21:39:28 12/19/04 (36)
- Re: Double Blind Comparison Tests - Soundmind 06:45:15 12/20/04 (0)
- The best defense is offense, eh Jon? - Pat D 05:56:34 12/20/04 (31)
- Re: The best defense is offense, eh Jon? - Jon Risch 18:28:38 12/20/04 (30)
- So you recommend special cables based on NO evidence. - Pat D 18:57:09 12/20/04 (29)
- Not at all the case. - Jon Risch 20:55:18 12/22/04 (1)
- I just applied your own standards, Jon! - Pat D 18:09:07 12/23/04 (0)
- Wrong - Commuteman 13:46:20 12/21/04 (26)
- Artificial setting up of "sides" - Pat D 18:34:36 12/21/04 (25)
- It's the essence of the DBT that you don't understand - Commuteman 21:29:16 12/21/04 (24)
- Re: It's the essence of the DBT that you don't understand - Steve Eddy 09:36:57 12/22/04 (19)
- The essence of the DBT ... - mkuller 13:39:04 12/25/04 (15)
- Re: The essence of the DBT ... - Bob Wortman 23:29:18 12/29/04 (5)
- High resolution vs hyperbole... - mkuller 09:30:53 12/31/04 (4)
- Re: The essence of the DBT ... - john curl 11:50:41 12/26/04 (6)
- Re: The essence of the DBT ... - uncle mag 12:03:55 12/30/04 (0)
- Re: The essence of the DBT ... - Steve Eddy 13:12:46 12/26/04 (4)
- Re: The essence of the DBT ... - Steve Eddy 00:31:02 12/26/04 (1)
- Where is the ABX stick? - mkuller 07:43:31 12/27/04 (0)
- Of course... - Commuteman 09:59:45 12/22/04 (2)
- Probability is the guide to life. - Pat D 08:14:59 12/22/04 (3)
- PS - Jon Risch 21:56:20 12/19/04 (2)
- What do Double Blind Comparison Tests prove? - Norm 13:11:29 12/19/04 (6)
- Re: What do Double Blind Comparison Tests prove? - andy_c 13:55:36 12/19/04 (5)
- We prefer to be referred as... - mkuller 13:50:07 12/25/04 (0)
- Re: What do Double Blind Comparison Tests prove? - Steve Eddy 23:01:10 12/19/04 (3)
- be sure to read some of the other articles... - BS64 06:02:36 12/19/04 (3)
- Re: be sure to read some of the other articles... - email@example.com 07:05:46 12/22/04 (0)
- Re: be sure to read some of the other articles... - Steve Eddy 22:47:09 12/19/04 (1)
- I was just trying to provide some links - BS64 11:50:03 12/23/04 (0)
- Here ya go... - BS64 05:46:10 12/19/04 (32)
- Re: Here ya go... - Steve Eddy 00:03:59 12/20/04 (4)
- nice post, Steve - jneutron 12:49:27 12/20/04 (3)
- I'm convinced - Soundmind 06:06:12 12/19/04 (26)
- Wrong, wrong, wrong. - Jon Risch 21:54:58 12/19/04 (6)
- Re: Wrong, wrong, wrong. - Soundmind 08:54:59 12/20/04 (5)
- Re: Wrong, wrong, wrong. - Bob Wortman 23:43:03 12/29/04 (0)
- Well, there's a question of R&D investment.... - Commuteman 11:06:21 12/20/04 (1)
- Re: Well, there's a question of R&D investment.... - Soundmind 12:57:44 12/20/04 (0)
- STILL Wrong, wrong, wrong. - Jon Risch 10:16:33 12/20/04 (1)
- Re: STILL Wrong, wrong, wrong. - Soundmind 11:01:51 12/20/04 (0)
- Discussion of a blind test is there - E-Stat 07:43:22 12/19/04 (10)
- Is this what you are referring to? - Soundmind 09:06:37 12/19/04 (9)
- Yes - E-Stat 10:59:54 12/19/04 (8)
- Tsk, Tsk - Soundmind 12:45:08 12/19/04 (7)
- I see - E-Stat 14:33:00 12/19/04 (6)
- "scientific" versus DBT - BS64 07:39:44 12/19/04 (7)
- Re: "scientific" versus DBT - Soundmind 07:57:57 12/19/04 (6)
- Re: "scientific" versus DBT - BS64 08:59:44 12/19/04 (5)Follow Ups
You can not post to an archived thread.