Nest Thermostat - Cannot set temperature when away

My Nest thermostat automatically detects when nobody is home. Via IFTTT I set up a notification, so I know it goes to away-mode everyday. To do this it uses the Nest internal (motion) sensor(s).

Sometimes homey does not adjust the temperature when I arrive home. And just about 5 minutes ago I saw the following in the log from the homey Nest app:
“Kon doeltemperatuur niet aanpassen naar 15 terwijl structure op away modus stond ingesteld”
Free translated:
“cannot adjust temperature when Nest thermostat is set to away”.

Anybody else has the same problem? It only happens when I arrive at home, when I leave or go to sleep Nest still thinks I’m at home. I cannot disable this behaviour in the Nest thermostat itself