It seems that Google has finally nailed this 24/96 streaming bug in the latest CCA firmware version (v1.39) or at least it works much more reliable for me now. Note, they've been performing staged rollout for this firmware for quite a while now and it was slow. It appears that the more you actually have been using your device over the last two months, the more chances it has to receive the updated firmware. Ironically, if you've stopped using your CCA (due to 24/96 bug) completely then it will never be updated and the bug will never be fixed for you. Weird as it is, this is my observation with the 4 CCA devices I've been using in my house. The only one updated initially was the one connected to a pair of Audioengine A2's which I use at the kitchen mostly to listen to Internet radio pretty much every morning, since low bitrates were not affected by the bug. Three other CCA pucks stayed at buggy firmware version forever, even despite repeated forced reboots. It took several tracks played on each of them across few days to eventually get all of them updated.
Hope this helps.