- Joined
- Apr 24, 2019
- Messages
- 1,501
- Likes
- 2,827
DBT is the sine qua non. Whether you use ABX or a different format is up to you. If the method is not double blind, it is hopelessly flawed.
As usual too much to lose.
DBT is the sine qua non. Whether you use ABX or a different format is up to you. If the method is not double blind, it is hopelessly flawed.
I guess nothing changes all the verbiage and wiggling to not actually do a blind no peeking test.
Proper blind test requires some equipment, which is not what a typical consumer typically has in his home.
I'd gladly participate in any blind test which someone prepares for me.
I'm too lazy to do such preparations for myself. Besides, I find them completely unimportant.
Should my impressions come from bias, I've no problems with that. As long as I'm satisfied with listening experience. I don't care why it's so.
There are my subjective expectations, there is my taste, all being personal and subjective. So why should bias be a problem, on top of that?
But I'll tell you why I think the bias is not decisive in my case. Because in a numerous occasions I was expecting one result from my bias (expectations from the renome of the product or manufacturer, price, topology/architecture, comments from the others), but my listening impressions didn't comply to any.
So when your listening impressions go the other way compared to your biased expectations, you learn to trust your hearing.
Still I would not claim I'm bias free, but as I've said, I've no problem with that.
I think it is difference of viewpoint. The AHB2, which went into protection due to transient response, had a maximum input of + 22dBu and a low load at the same time. Unlike an amplifier used in a concert, amplifiers used in homes and studios are not common in transient input situations. I think it is more appropriate to protect the user's speaker or ear when entering the protection mode when the transient input occurs.
In addition to bias (unconscious or otherwise), there could be other factors such as mood, fatigue, illness affecting hearing acuity due to pressure or other factors, distractions, and so on. (Naturally, these particular negative factors could also affect the outcome of blind tests, not just sighted ones.)Do you think a possible bias is the only possible reason for not correctly hearing the difference?
I would need to dig into a particular methodology to find whether it has obvious flaws.
So far I'm pretty certain ABX methodology is completely flawed for the purpose of hearing a difference. I proposed a better one, here.
I ordered another AHB2 last week and will perform measurements under the same conditions for performance testing. If you have a test method you would like to see, please respond. After the test, I will post the results. However, my AHB2 still can not start shipping due to lack of stock. It will take a very long time to come to Korea where I live.
Proper blind test requires some equipment, which is not what a typical consumer typically has in his home.
I'd gladly participate in any blind test which someone prepares for me.
I'm too lazy to do such preparations for myself. Besides, I find them completely unimportant.
Should my impressions come from bias, I've no problem with that. As long as I'm satisfied with listening experience. I don't care why it's so.
There are my subjective expectations, there is my taste, all being personal and subjective. So why should bias be a problem, on top of that?
But I'll tell you why I think the bias is not decisive in my case. Because in a numerous occasions I was expecting one result from my bias (expectations from the status of the product or manufacturer, price, topology/architecture, comments from the others), but my listening impressions didn't comply to any.
So when your listening impressions go the other way compared to your biased expectations, you learn to trust your hearing.
Still I would not claim I'm bias free, but as I've said, I've no problem with that.
Long term non-blind non-level matched comparisons are pretty good to find your preference.
You'll be listening to pretty various levels and content and you'll get a picture which makes you more satisfied.
So, what is the truth here? Something other than personal satisfaction, preference, taste?
I don't need to know anything in particular about you to answer this quick reasoning.
If listening to two amplifiers long term under sighted conditions, you may "believe" you prefer the sound of one amp over the other.
But it might have nothing to do with the sound. You may just prefer the looks of one amp over the other and the human bias conditions take over. Under sighted conditions there are any number of reasons you might be fooled into believing one is your sound preference.
I need to know nothing about you to know you suffer the same human weaknesses as us all.
Hi Sal,They're terrified actually. They know the whole subjective audio world is built on a house of cards and with the removal of just one or two, the whole thing will collapse. They hang together making unsubstantiated claims of DBT's being fatally flawed without ever being willing to publicly test their position. There are at least a couple offers I know of with money on the table that no one will step up to.
Huh???Hi Sal,
How about you? Are you “terrified”? Are you willing to put your beliefs to the test? Or do you make exceptions for certain closely held beliefs, for whatever reason? Projecting, maybe? I know of one of those offers of money on the table, you mentioned. Did you step up to claim it? Feel free to PM if you think you have anything convincing, I’d love to hear it.
https://en.wikipedia.org/wiki/One_Million_Dollar_Paranormal_Challenge
There may be something to this. I think it would apply to rather large signal differences however. I think level matched and blind you can get positive results for smaller signal differences.I don't have a dog in this race and have no expertise in audio or acoustic engineering. But I wanted to point out that from a perceptual point of view, the above statement is not without merit. After a few exposure to stimuli from the same family, your brain will quickly learn to approximate its underlying generative process - think of estimating a distribution from multiple samples. From there on, you can quite effectively recognize stimuli that don't belong in the same family. See figure 1 of this paper for a quick demo.
Applied in this context, this could mean (whether it actually does, I don't know) that multiple exposures over the long run may in fact obviate the need for level matching and other control criteria.
Hi Sal,
How about you? Are you “terrified”? Are you willing to put your beliefs to the test? Or do you make exceptions for certain closely held beliefs, for whatever reason? Projecting, maybe? I know of one of those offers of money on the table, you mentioned. Did you step up to claim it? Feel free to PM if you think you have anything convincing, I’d love to hear it.
There may be something to this. I think it would apply to rather large signal differences however. I think level matched and blind you can get positive results for smaller signal differences.
An example, over the years I've been surprised at how many audiophiles listen to amps in occasional overload or even mild clipping. I don't have any reason to think I'm especially sensitive or attuned to it. Various amps under various loads clip in somewhat different ways or more accurately recover from clipping in different ways. So I suppose I've learned from various single shot examples and can hear it even when the specifics to something I've never listened to exhibit enough signs for me to perceive, "hey this is clipping now and again". I even know of a fellow who seemed to only stop turning up volume when he began to cause a similar level of overload across several different systems. Like he wanted 1-3% clipping or something.
But clipping is a pretty gross difference in signal. Level matched testing can ferret out far smaller differences than that.
I might even believe it possible for two amps or systems with perceptible frequency response deviations. Then again, such deviations can be much more finely discriminated with good testing or even the right signal. Music is rather poor for that unless the difference is large. Listening to a few seconds of pink noise at moderate levels will quickly let you hear that kind of difference at much smaller differences than you'd hear long term with music.
Bias is only one factor that interferes with reliable results. The most common error is that you listen differently to A versus B. Your brain has the ability to focus on detail or not. When you know the identity of products, you will tend to fall victim to this thinking one device has higher fidelity, etc.But I'll tell you why I think the bias is not decisive in my case. Because in a numerous occasions I was expecting one result from my bias (expectations from the status of the product or manufacturer, price, topology/architecture, comments from the others), but my listening impressions didn't comply to any.
Please don't be ridiculous. Do you think non-level matched listening tells you anything comparing amps for sound? Let me answer that: no. If you disagree, express your reasoning and you can learn from this...
OK, so you don't have a single example.
This is a widely proposed view but actually I think this serves only as a way to make you feel that you have made a good choice in your own mind but there is actually no way to make comparisons of any validity in the long term IME.Long term non-blind non-level matched comparisons are pretty good to find your preference.
You'll be listening to pretty various levels and content and you'll get a picture which makes you more satisfied.
So, what is the truth here? Something other than personal satisfaction, preference, taste?