Google Home and door lock


I have a ID lock 150 with z-wave module. So it works fine within Homey. But I also use Google assistance and Homey has synced the lock up to Google home.

This is not anything I want, because someone can theoretically just shout “open door” and Google will do that. Is there a way to just sync specific devices to google home(can’t find this). I also read that you can set a security code in Google for the lock that you need before it opens the door, but can’t find that
Option when the lock is synced from Homey.

Any tips would be appreciated.