Tradfri on / off dimmer ramp up / down

So this might be a long shot;

did anyone managed to use this switch directly connected to Homey to ramp the dim function up / down?

If I configure it to “long press” dim relative 5% I need to release the button to have it going up to the next 5% setting.
When directly connected to a bulb it ramps up and down while keeping it long pressed.