I use my homey for my home automation but for fun I also still have a home assistant vm running.
Home Assistant has now added the possibility to add an llm loke chatgtp, they have also releases an external wifi microphone that listens to a wakeword.
Where home assistant usually complicates stuff enormously this is not like that.
The setup litteraly tool 10 minutes (noted that I did have a chatgtp subscription allready).
What does this thing do ?
It listens to the wake word and if it hears it it sends the voice to the api of the llm together with a blob of state data for your devices.
Then chatgtp takes over, it analyses the question and, based on the blob sends back a structured reply that home assistant can do something with as well as a response in text that is changed to a voicr output and played thru that same wakeword microphone/speaker.
What is the end result ? You can talk any way hou want and home assistant will do as you ask… it really is quite amazing..
Now… why to state this hear ? It seems that this would be a very nice thing to have on the roadmap and I feel homey has everything in place to do the same…
It also feels like something that fits way better to homey then to home assistant..
Anything like this somewhere in a roadmap ?
3 Likes
I’d also really like to see this, it’s the one thing keeping me on the fence about Homey Pro. LLMs/LAMs are going to be a critical part of the smarthome future, but so far it seems only HA has a decent solution for this besides Alexa+
Would be nice but I feel something else is needed before..
An LLM would be great in understanding a non structured command and figuring out what the users means, then do the right thing..
So instead of alexa code-words just natural speak that ends up working.
Homey currently however misses voice input so there is no real way to give unstructured text to the LLM.
What would be good is an external device that works as a microphone and speaker that is able to wait for a wake word, then takes the voice and sends it to a backoffice system TOGETHER with status information on the home devices.
That way a voice prompt like “yo dude, how many lights are on currently” would give a correct response (that could be given using the sale device).
Such a device was built by the colleagues of home assistant, I bought two to try. They are now lying in a drawer because while it worked basically it was no the polished experience that we are getting out of Homey..
Earlier Homey removed the voice input and output options because it was not doable to keep up with what the big boys were doing..
BUT… we now have LG on the ball and I cannot imagine such a project NOT beiing worked on at the moment… I am just waiting for the “we have a great announcement” message !
I agree with everything you’ve said including the home assistant option not being anywhere close to ideal just yet. Good news is I’ve seen in the newest LG AI video the exact thing I’ve been wanting, and it even appeared to be running on a Homey hub! I’m assuming this is just a proof of concept right now, but they are definitely thinking about it
It will be running somewhere in the cloud, probably for a monthly fee.
Probably, but happy to pay if it works !
Op wo 16 jul , Robert Klep via Homey Community Forum <> schreef:
