I have now found the solution for myself: It was always the dongle that was responsible, one after the other would drop out. Now I simply connected the mice via Bluetooth, which eliminated all the problems.

I also have this problem, but mainly on Windows. And with two different mice. On Mac, I have noticed it less or not at all.