So moving the favicon into a new path, causes all browsers to reload it? That’d be an easy wonderful fix. Is that what you are saying?
If they’re served an uncached version of the HTML, my experience is that it is indeed the case.
My suspicion is it’s exactly what that query string is for. Also at the lack of seeing another reason.