Direct association in combination with app/flow

I have a fibaro switch which has a direct association with a fibaro wall plug. When the switch is pressed the plug changes status as expected. When I turn it on via the switch but then turn it if via the app the status of the switch remains on. When I press the switch again nothing happens as it is turning the plug off which it already is. Similar when it is on. So my issue is association action + app or automated flow action + then again association. Is there a way to let the switch know it status should change? It is a pulse switch. Any ideas on this?