I like the blind level matched tests - the only problem is that it all depends on what is in the group test. A speaker may win the group test but in another test it may have come in 6 out of 8. Or a speaker that finished mid pack in one test may very well win with a different group of loudspeakers.
My Audio Note J speakers were part of their group tests for standmounts. But it blew them all out of the water because the J has significant bass depth and dynamics (and bass matters). Two problems arise. If everyone knows the speakers they know the J has significantly better and deeper bass than standmounts from the likes of B&W, Paradigm, PSB etc. So it's a "known" entity for the listeners who could mark it up or down based on preconceived opinions of the product or owner.
So Hi-Fi Choice decided to "be fair" and put the AN J in the floorstander group test so that the significant bass advantage would be alleviated. The J won the test anyway and it still out-bassed the floorstanders (even not placed in corners).
Regardless of the result though I am not sure it was a fair test. 2 reasons. First, it's a standmount speaker - In theory it has certain sonic advantages to big multi-way loorstanders (better integration of drivers yields better midrange response). The floorstanders were at a disadvantage (OTOH they should have beaten the J on bass and none of them did - so...) Secondly, I am not sure why the AN J was pulled from the standmount test. If the other mainstream manufacturers at similar dollars have anaemic gutless bass and dynamics why should the J be penalized and taken out of the test? Maybe the sound drubbing of those other models would make them redesign their products to not force buyers into immediately spending more large coin on a subwoofer or two.
I agree with all your points - most stuff is pretty good - even Bose has been getting very good press lately for their surround sound systems. It's rare to really find something truly bad (when price is factored in).
I also find the results inconsistent. However, where possible try to follow the products that have been tested several times - Sugden's A21a for example seems to win every test. Likely because of the SET design no feedback design.
Less important than the actual amplifier the fact that a 1990 design beats 2010 designs should be a wake-up call that a good old design is not beaten by the new simply because it's new and hyped. And that's worth something.
Edits: 07/04/12
This post is made possible by the generous
support of people like you and our sponsors:
