@Arve_Bjornerud thanks for the app, it’s exactly what I’ve been hoping for.
I wish to run local voice AI.
I have rooted an Amazon Echo Dot 3 Gen3 and installed GitHub - Gamer92000/echo-dot-assist: Turn Amazon Echos (Echo Dot 3, Echo Dot 2, Echo 2) into local Home Assistant voice satellites. Keeps Amazon's mic processing and wake word engine, replaces Alexa with a small C daemon speaking ESPHome or Wyoming. Multiroom music via Music Assistant, Bluetooth speaker and proxy, no cloud. · GitHub on it.
After that I used a custom pipeline in your AI Voice Assistant app.
Everything is running in docker containers on Latest Debian (5700g, 32gb, with an nvidia 3060 12gb gpu)
speech-to-text: is (openAi compatible custom url) speaches-ai/speaches:latest-cuda
text-to-speech: is Wyoming-Piper (Local) rhasspy/wyoming-piper
Language: I have tried both LMstudio & Ollama with Qwen 2.5:7b and Qwen3:8b
All 3 custom inputs (STT, Language, & TTS) test correctly (i.e green), However…
The echo dot hears me, activates the echo in homey but NOT the device being switched on or off, and then answers me that it has switched the device on/off .(i.e it seems to work but actually fails)
I tried some of the other options as well… (Mistral & Gemini Live).
Mistral hears me but then does nothing - If I try Mistral as custom Url (I was going to use it just for the language part) it clears the test for both STT & TTS, but when I try to use it for language it fails.
Finally Gemini Live works perfectly… It hears me, and switches on the device, and then responds.
I haven’t tried OpenAI.
I really would like to get local language going… Is it failing because the models I’m using for my weak gpu aren’t good enough? I’m new to AI, so don’t really know what to expect from local processing..
Or am I just using the wrong models? or not tweaking them correctly.
Any help would be greatly appreciated. Thanks