See also here:
It simply isn’t possible in the current configuration.
The only workaround is to have your wife disconnect her google account from the Smart Speaker such that the smart speaker doesn’t recognize her voice and it automatically uses your routines
