I don’t think it’s annoying, and usually find it necessary to press a volume button two or three times before noticing any real difference in volume.
If you want finer control, this is available in the WiiM Home app, where touching the volume slider on either side will alter in increments of one.