Seems that some people get lucky and Homey makes a good Zigbee-mesh (or have all Zigbee-devices within range of Homey).
I also didnt have any issues with devices that was close to Homey, but devices far away depending on mesh was struggling.
Hopefully they solve this in the future so i can throw out the Hue Bridge. But for now that has solved my issues!
