Technical and scientific discussion of amps, cables and other topics.
Return to Propeller Head Plaza
What is missing in measurements, so there's lack of correlation between them and sound quality?
129.33.19.254 |
||
| Posted on October 27, 2009 at 09:49:33 | ||
|
Posts: 2634
Location: NJ Joined: September 20, 2006 |
I know it was discussed, if not beaten to death, before, but this post is prompted by recent exchange on PC Audio forum about Benchmark vs. Wavelength DACs, used with computer via USB. What measurements are there, show superiority of Benchmark in every category (which prompts "objectivists" to talk about "engineered colorations" and "deliberate colorations as design goal"). However, posters who actually listened to both, have no doubt which one sounds better - and that ain't Benchmark. Almost the same goes for Benchmark vs. Ayre QB-9 - comparable measurements, superiority of Ayre in sound quality. Links to measurements: http://www.stereophile.com/digitalprocessors/108bench/index4.html http://stereophile.com/digitalprocessors/wavelength_cosecant_v3_usb_digitalanalog_converter/index5.html From my own experience, Benchmark (silver-faced, so one of the latest generations, if not the latest) via AES/EBU was somewhat harsh in highs and forward sounding, easily outclassed by several solid-state DACs I tried in the same and higher price range - so preference for "tube" sound (Wavelength) is not the reason. So, what gives? |
|
| RE: Your words, not mine., posted on November 3, 2009 at 11:51:44 | |
|
Posts: 963
Joined: June 2, 2007 |
"For digital, where distortions are low in magnitude, the characteristics of the sound are made up largely by analog non-linear effects (harmonic distortion, phase shifts) and digital non-linear effects (jitter). This is why the linear distortion of a slightly rolled off high frequency (who is going to hear -3db at 20Khz anyway?? Not many I suspect) is likely to be inaudible and unimportant but how the two deal with jitter and phase-shift possibly very important." Did you notice in the Stereophile review of the Ayre QB-9, in the measurements section, the effect of having the digital LPF in "Listen" mode on intermodulation distortion using 19kHz and 20kHz signals? Check out Figure 13 on this page. At first, I was baffled about why a change to the digital filter, which is nominally a linear circuit, would affect measured distortion that much (though it's not really that bad when you look at the numbers). Then I realized that in "Listen" mode, it's letting through quite a bit of signal at the image frequencies of 44100-20000=24100Hz and 44100-19000=25100Hz. Then these two images at 24100Hz and 25100Hz are causing the analog circuitry some trouble. I don't think I like these "Listen" filters. I'll take a linear-phase brick wall filter any time (for Redbook anyway). |
| RE: Your words, not mine., posted on November 4, 2009 at 19:30:57 | |
|
Posts: 963
Joined: June 2, 2007 |
"So in this case it seems that the wholly unnatural behavior of the standard linear phase filter that gives pre and post ringing (something impossible in the "real" world of acoustic sounds) outweighs the increase in IM distortion, which while possibly audible seems not to be as damaging to the sound quality." There's an interesting thing that comes into play though. If the input of the brick wall filter is bandlimited to less than its cutoff frequency, the brick wall filter doesn't pre-ring if there is no pre-ringing at its input. The filter, being linear, won't ring if there is no energy at its input at the frequency where it tends to ring. That is, it won't generate frequency components not present at its input. There's a great post by Werner on this subject here. I haven't heard any of these new DACs though, as I'm not in a position to be auditioning them. |
| RE: Your words, not mine., posted on November 4, 2009 at 07:52:16 | |
|
Posts: 4438
Joined: January 16, 2003 |
"Hmmm...have you played around with a DAC with switchable filters??" Have a look at the measurements of this 10-year old player. Note John Atkinson's commentary on image leak-through. "...The 4th mode is slightly better than "measure" but loses impact in the music. The "measure" mode sounds much more artificial and "digital" while the two other modes are more analog sounding and have only post ringing I believe." Nothing stops someone else coming along and preferring a different set of filters and giving precisely the same reasons you've stated here. IMO, this is where controlled testing comes into it's own. Does the Ayre QB-9 sound the way it sounds because of the Minimum phase filter, I have my doubts. Or is it because of artefact's associated with it's slow roll-off, it would interesting to test Linear Phase filter with an equivalent slow roll-off and reached to some informed conclusions. In conclusion, the OP question has been answered the Ayre's measurements are not comparable to the Benchmark. The measurements give some clues as to why the Ayre might sound different from the Benchmark. When a benchmark, such as the CD standard, is reached by juggling a set of conflicting performance parameters it's no surprise that someone else might prefer to the draw the line at a different point. |
| RE: Oh and I forgot to add..., posted on November 6, 2009 at 10:23:49 | |
|
Posts: 963
Joined: June 2, 2007 |
"It must be realized that the IM distortion in the measurement is not really IM distortion but Aliasing." Actually, it is both (assuming you change the word "aliasing" to "imaging"). One ends up with two desired frequency components f1 = 19kHz and f2 = 20kHz. But then there are the undesired images at f3 = 24.1kHz and f4 = 25.1kHz. This aspect is of course imaging and not IM distortion. However, the signals at frequencies f3 and f4 are slightly less than 10dB down from those at the desired frequencies of f1 and f2, and are not themselves harmonics or IM products of f1 and f2. This situation has turned what should have been a 2-tone IM distortion measurement into a 4-tone IM distortion measurement, in which the third and fourth tones don't even belong there to begin with. For the two-tone case, the frequency components at the output will be at |m * f1 +/- n * f2|, where m and n are 0, 1, 2, 3,... and so on. But with four signals, we get frequency components of |m * f1 +/- n * f2 +/- p * f3 +/- q * f4|, where m, n, p and q are again 0, 1, 2, 3,... and so forth. Many of these, as can be seen in Figure 13 here are in-band. And of course all of these for which either p or q (or both) are not zero will not show up in the simpler two-tone IM test.
|
| RE: Oh and I forgot to add..., posted on November 12, 2009 at 18:13:40 | |
|
Posts: 963
Joined: June 2, 2007 |
Well, I wasn't referring to crossover distortion in the analog stage, but distortion of the DAC chip itself. An ideal DAC chip will have uniform quantization steps (change the input bit count by one, and the output current or voltage should ideally change by the exact same amount for each such change over the full range of bit counts). In real DACs, these step sizes are somewhat non-uniform. As the signal variation gets smaller and smaller, the DAC error due to the non-uniform step size becomes a greater fraction of the desired signal, making distortion increase as signal level decreases. This happens even with a theoretically perfect analog stage following the DAC. The old ladder-style DACs were particularly susceptible to this, but modern DACs use a technique called dynamic element matching (large PDF file), which improves the measured distortion performance of the DAC chip a lot. |
| RE: Oh and I forgot to add..., posted on November 13, 2009 at 09:29:32 | |
|
Posts: 963
Joined: June 2, 2007 |
Let's set subjective issues aside and just talk about measurements. Any device whose gain varies with signal level will produce distortion. Some of the Stereophile DAC reviews include plots of the gain error vs. signal level. Unfortunately, the Ayre review doesn't include these data, but the Benchmark DAC1 USB review does (on this page). The relevant graph is linked below:
The left axis is for the blue trace (output in dB vs. input in dB), while the right axis is for the red trace (output error in dB vs. input in dB). The blue trace should ideally look like a perfect straight line, because every 1 dB increase in the signal level in the digital domain should give a corresponding 1 dB increase of the analog signal. The red trace shows the error from the ideal. As the signal level gets less than -100 dB relative to full scale, the error begins to increase, reaching about -2 dB, then swinging up to about +4 dB. This error is orders of magnitude worse than a class AB analog circuit without any feedback at all, and completely dominated by the DAC chip. Also notice that the measured distortion of the Benchmark is better than the Ayre, including high-order distortion components.
|
| RE: Oh and I forgot to add..., posted on November 15, 2009 at 10:51:26 | |
|
Posts: 963
Joined: June 2, 2007 |
"Is 1 or 2 db error at -110db worse than high order harmonic distortions?? Whether that signal is -110 or -112 or -108 probably doesn't matter very much." I'd agree that this level error, in and of itself, is probably meaningless subjectively. But such a level error cannot occur without distortion, so it cannot be considered in isolation. For a nonlinear input-output characteristic, I'll refer you to the "Crunching the Numbers" section, of Keith Howard's article, which I believe you're familiar with. In the first equation, there's a second-order term involving the constant "b", a third-order term involving "c", and so on. Let's assume x=x(t)=V*sin(omega*t), where omega=2*pi*freq. To find the harmonics, we'll need trig identities for sin2(omega*t), sin3(omega*t), sin4(omega*t), sin5(omega*t) and so on. There are a whole bunch of trig identities that relate the sin or cos raised to integer powers to the harmonics and other undesired components one ends up with. Keith Howard mentions a few. I won't get into the details of the math, but here is a summary of the qualitative results. 2nd-order term: creates second harmonic plus an undesired DC offset term. So you can see from the above that all the odd-order distortion terms create an undesired signal component at the fundamental frequency. These correspond to the gain error, and, depending on their polarity, they may subtract from or add to the fundamental. Another way of looking at this is graphically. If there is a gain error that depends on signal level, this says the plot of output vs. input is not a straight line. This is equivalent to saying that distortion is present. In the RF world, there's a thing called the "1 dB compression point", which is related to how much output voltage or power a circuit can produce. It's found as the point where increasing the input signal by 10dB causes the output to increase by only 9dB. Although this is only a 1dB gain error, it is usually associated with gross distortion, with distortion components in the neighborhood of 10 to 20 dB down from the fundamental. The bottom line is that harmonic distortion measurements, though difficult or impossible to relate to the subjective experience, are nonetheless very sensitive. Very small gain errors with signal level show up as significant harmonic distortion components. It just so happens there's a great example of gross DAC distortion at low levels in a review that Stereophile just added to their web site. It's on this page. Below are plots of the linearity error vs. signal level, and the distortion of a sine wave at a fixed level of 90dB below full scale.
You can see that the desired signal is around 87dB below full scale instead of 90dB as it should be, and gross levels of distortion are present.
These are actually nonlinear distortions, as explained above. With speakers, this happens at high signal levels. With class AB amplifiers and DACs, one ends up with distortions that can increase as signal levels decrease. So what I've been trying to do, maybe with mixed success, is to point out the similarities of DAC distortion and distortion of class AB amplifiers at low level. "So, I am not at all sure that this error is worse than a Class AB analog circuit without feedback (if such a thing was even possible with op amps, which it is not actually)." I hope I've demonstrated, at least from a measurement point of view, that the distortion of a poor DAC such as the one above can be orders of magnitude worse than a class AB circuit without feedback. You're right that such a thing can't be implemented using op-amps alone, but it might be implemented with an op-amp having an external class AB buffer such as a BUF634 at its output, outside the feedback loop. A very interesting example of a class AB circuit without global feedback is the Ayre MX-R power amp. Its distortion, shown below, is surprisingly low for a circuit of this type.
|
| RE: Oh and I forgot to add..., posted on November 10, 2009 at 09:43:01 | |
|
Posts: 963
Joined: June 2, 2007 |
Looks like we posted at the same time :-). |
| RE: LOL! Good luck in your search. -nt, posted on November 1, 2009 at 01:25:53 | |
|
Posts: 4438
Joined: January 16, 2003 |
*
Music making the painting, recording it the photograph |
| RE: What is missing in measurements? In this case, not much, posted on November 2, 2009 at 02:42:19 | |
|
Posts: 1829
Joined: September 30, 1999 |
"The raw signal on the CD is inherently rolled off due to modulation." That is somewhat of a misrepresentation. The signal on the CD, i.e. the sequence of sample values, is not rolled off. But it comes with the requirement that the sample values should be interpreted as being the energies of a sequence of dirac impulses. Upon playback, or even upon numerical analysis, the samples are often interpreted as attached to levels that are invariant during one sample period (hence the staircases in graphical representations or the typical NONOS DAC output signal). This interpretation, named zero-order hold, is a linear operation implicitly added to the signal's processing, and the frequency response of this operation happens to be a treble rolloff (which follows Sinc(f) by the way). If the samples were to be replayed through a hypothetical dirac impulse DAC (*) then this treble rolloff would be absent. (* Which does not exist but can be approximated by oversampling with a filter kernel [0 0 0 0 0 0 0 1 0 0 0 0 0 0 0], as demonstrated in the link below) bring back dynamic range |
| Or maybe someone forgot to ask for your personal opinion?nt, posted on October 27, 2009 at 16:00:07 | |
|
Posts: 7440
Joined: November 13, 2002 |
nt |