My guess is this will only work if the Spotify app is opened on your phone. The app is intended for smart speakers using Spotify Connect, not for playing Spotify on your phone afaik.
