I do firmware for a living... have programmed a couple of DSPs in my time. Yes, the filters selected and such makes a big difference.
Agreed. Measurements and observation must be correlated and listening experiences need to be controlled. Otherwise we can't achieve repeatability.
Even if we don't know "WHY" our psychoacoustic behavior works in some ways, we should at least be able to measure the electronic status related to a given listening interpretation.
In this way we learn and push the science of psychoacoustics forward.
I don't think we need blind testing, just a controlled listening environment.
I can give you my own experience. The soundstage of a given recording changes, and not for the better, when I use the WiiM own DAC and linear output section vs using an USB DAC. The soundstage is not as deep. For this I used a carefully set up system in my office, listening in the near field with some recordings. The soundtrack of Amadeus is perfect for this... listen to the concertos.
The distance from the front instrument to the back, the pinpoint lateral location of the instruments, all sound more accurate and obvious with the external DACs.
Or rather, with the same recording source, changing only the DAC and analog output, the soundstage changes and the voices in a choir sound more separate, never harsh. The WiiM has the shallowest soundstage.
It is repeatable.
- Used Tidal HiFi Connect over WiFi -AP is in the same room
- Amadeus soundtrack ( voices, choral, massed strings, orchestra with soloists up front, piano with orchestra, a soundstage stress test).
- The DACs I used for these listening sessions are Burson Swing with Burson Vivid v7, Topping D90LE and Nitsch Pietus Maximus with Schit Multibit DAC and Unison USB. (*)
- DIY F4 and FW F6 amps.
- Acoustic Energy AE1 speakers.
Mind you for this I used the Blue Book version... there are better higher def versions but if I'm gonna listen to one thing over and over and over... well... I better really like the piece. I just wanted to hear the differences.
Now, I posit the issue here is not the DAC per se but the output section... I can, and do, roll amps in the Burson Swing... it makes a difference too!
I guess next, what I ought to do is use the Lycan op amp tester between the amp and the WiiM's own DAC analog output and see what happens. It has a high impedance and will not draw much current from the WiiM but put in a much more "powerful" buffer to the amp. In essence buffering the WiiM from the amp.
I suspect that the sound will change too. And for kicks, I got something like 15, or more, different kinds of opamps.
I went through this with the phono preamp... eventually I settled with the Burson Vivid V7 in there too... but I need to go back. If you want audiophilia nervosa sit down for a weekend to compare the sound of your phono preamp with a bunch of different op amps... take notes... the difference is obvious between some types.. for others, like the ENTIRE Burson opamp history, the changes between generations is more subtle...
My point being that I can hear the differences. So a manufacturer can, and should, run measurements to figure out why. That's the "science" part, the rest is engineering and marketing.
(*) I used their own power supplies... some linear, some switching... I didn't want to open yet another can of worms here. I did use upgraded op amps in the Burson, but they're Burson too, so I figured that was fair and I only have one life to live...