To my understanding this is something that sometimes just happens and there’s no real solution. Sometimes some changes in a ZigBee mesh helps, but I haven’t found any reliable solution. In my case it resulted in giving up on Homey ZigBee radio, I moved to integration via Philips Hue bridge (which runs much smoother IMHO).