Firmware regression testing

[jamster]

I have noticed a tendency to introduce new bugs whilst trying to fix existing ones.

In the past few weeks

- Qobuz Connect was broken by a firmware update (phantom playing when using a USB Dac)

- HDMI Arc - which has worked perfectly since I bought the device - is now unstable to the point that it mostly doesn’t work on my LG G4. Ironically, that firmware update boasted “improved stability” for HDMI Arc.

This is a very poor user experience. I hope there will be a refund option if stability cannot be improved as it’s not possible to enjoy the devices if they keep getting broken by forced, automatic firmware updates.

 

[Machiavelli]

What I have learned now is that my opinion that EVERY sword is double-edged was absolutely wrong. Have googled it to give a smart response but this time I failed. Shame on me, praise for the forum. So this day already gave me knowledge for the next tv quiz show.

 

[Zap Rekowski]

Regardless of what we're talking about here, these frequent firmware updates really nerves me.

I usually only sit down in front of my Ultras on weekends to really enjoy some music. I use the Minis/Pros for entertainment in the kitchen, study, etc. All devices are connected via switchable power strips.

I hate it when I want to get started and first have to waste precious time on FW updates. Every now and then is OK, but the frequency is annoying, especially since many of the features don't interest me at all. WiiM doesn't have to fulfill every wish; it could update once every three months, for example, or only in the event of serious, critical problems. Otherwise, they can explicitly make pre-release versions available in case of problems, should anyone contact them. A positive side effect would be that they would have more time for testing...

 

[Saponetto]

Firmware development timelines are always a deep mystery for our final users, but for sure you are right.
Imho this feature race is not a good thing either for the developers and for final users.
Letting an update frequency similar on the one for Pro or Pro+ could be more reasonable.

 

[Zap Rekowski]

It's a double-edged sword: on the one hand, we may be excited about new features, but on the other, they can be disruptive.

I have two HTPCs. A few years ago, they were initially based on Linux, but due to some incompatibilities/poor compromises, they were later switched to WIN10 and now WIN11. Software/operating system updates have always been and still are necessary (I am one of those people who feel compelled to install them as soon as they are available). It is/was really annoying because it can spoil your enjoyment of listening to music.

In this respect, I consider streamers to be a good thing for consumers, as they (should) prevent me from having to deal with IT. As I said, I realise that FW-updates are necessary, but please in moderation and only when necessary. Unlike Yamaha, Panasonic, Lenco, Arylic (my previous streamers), WiiM goes a little overboard here... Just my opinion. Regardless of this, the WiiM streamers are the best of all those mentioned, and I don't regret buying them.

 

[hgo58]

@WiiM Support could just add the latest firmware to the list of beta tests, available from the WiiM Home App.

Now done



Thanks @WiiM Team

 

[Burnside]

Now done

View attachment 24744

Thanks @WiiM Team

Just seems to be the Ultra for now - hopefully it'll come to all devices.

 

[Mr Ee]

Nice.
I can see this for my Ultra, maybe the other devices will get it soon.

 

[Burnside]

Nice.
I can see this for my Ultra, maybe the other devices will get it soon.

Snap

 

[hgo58]

Just seems to be the Ultra for now - hopefully it'll come to all devices.

It will probably with next update.

And hopefully the documentation will also be updated to explain this feature?

I wonder if WiiM will add or replace the previous version when a new is released?

 

[Mr Ee]

I guess we'll have to wait to see how it works over time, but I have to say I'm impressed that Wiim have added this ability so quickly.
If nothing else it'll cut down their manual work performing rollbacks from tickets, with the benefits that brings to both them and us as users.

 

[Wiimer]

Does that mean that every time someone posts in the troubleshooting thread, we have to ask for the FW version and remember how that version worked?

Sorry to be negative, but this is a bit depressing

 

[Mr Ee]

Does that mean that every time someone posts in the troubleshooting thread, we have to ask for the FW version and remember how that version worked?

Sorry to be negative, but this is a bit depressing

Maybe, but with the phased roll-out of releases currently it seems reasonably common for there to be users on the previous release many days after others have updated. (Edit: even my own pros can update days apart.)
But you enjoy a challenge...

 

[Burnside]

Does that mean that every time someone posts in the troubleshooting thread, we have to ask for the FW version and remember how that version worked?

Sorry to be negative, but this is a bit depressing

I think it should be made clear somewhere that before submitting a ticket to WiiM or the forum that the latest firmware version is installed. Indeed, it should be good practice anyway that posts clearly state version numbers, devices, services etc being used otherwise we can spend a deal of time trying to establish the base from which we're working. Also, we sometimes don't even get what users are actually trying to do, just that they can't get one potential method to work viz. the recent discussion about Windows default sound devices which was touted as the means to an end that wasn't adequately explained up front.

 

[jamster]

I understand that issues like this can be frustrating, but comparing it to the universally panned Sonos botch is a bit of a stretch. Do you have any idea what regression testing something like this entails? There are virtually unlimited combinations of gear brands and models that people will (try to) connect to this hardware in every different way, multiplied by every feature and function within the hardware itself. Considering the very few complaints about things breaking, at least that I’ve seen, we’ve got a good long way to go before we’re approaching Sonos territory.

I understand your point. My issue is that - with something like HDMI Arc - which is known as a hot mess of poor implementations - making changes without a full suite of regression testing is *going to cause issues*. If I buy a device, it doesn't work with my TV, I return it. If I buy a device, it does work with my TV, I expect it to stay working. I don't expect it to break because they've been trying to make it work better with other people's TVs. Not trying to be combative, just setting my expectations. I think WiiM risks trying to be *too accommodating* to users' needs, and introducing unnecessary bugs in the process.