Awesome Tips This new smart speaker will change everything!
Home Assistant Voice Preview edition is completely local, but it has some major kinks to work out.
Home Assistant Voice Preview edition is completely local, but it has some major kinks to work out.
Ad: Remove your personal information from the web at use code SMARTHOMESOLVER for 20% off
Home Assistant Voice Preview Edition:
My smart home favorites:
My smart home shirts!
USA:
International:
FOLLOW ME
Subscribe to Smart Home Solver:
Subscribe to Reed’s Smart Home:
Twitter:
Instagram:
TikTok:
0:00 Intro
0:30 Hardware – Preview Edition
3:21 Keeping it local
5:52 Connecting the pipes
8:50 What it can do
12:00 The future
13:40 Voice assistant battleđź’Ą
———
MUSIC
Digifunk by DivKid
All of the music throughout is by Nihilore.
Spotify playlist:
Ending song is The End by EVA.
Deals for Days. Big home savings are happening now.
The few Amazon Echos I still have set up are terrified of this thing. You can get one here: https://home-assistant.io/voice-pe
Hahhahaha, hey babe definitely works sometimes. Hahahahahhahaha.
I wonder how this compares to that local way of doing it with a raspberry pi. The only issue I had was that the speaker wasn't that great. So I was thinking if something like this works fine, I could rip open my echos and steal the speakers and maybe case and it could work the same way with great speakers.
This is cool, but 60 dollars is insane
I've been playing with ESPHome the last few days with a Raspiaudio Muse Luxe speaker, and I agree that it is still quite dodgy. I'm certain that it will get loads better over time.
I’d like to know what specs are considered “powerful hardware”, which is a very vague designation for what I might need to run it entirely locally.
I have a Dell Wyse 5070 mini PC that has a pretty low base clock speed but can get some pretty decent boost speed. It’s been running HomeAssistant OS very reliably but I’m not sure how intensive the voice assistant add-on will actually be on it.
Talking about being CRITICAL!
if is not ready why make a video!
So basically you're saying you need to straight up run it through your home hosted GTP so that it understands normal sentences, that's really not a big deal.
You should definitely try pairing it with an LLM. There are cloud and local options. It has built in support for ChatGPT (cloud) and Ollama (local). There is also HomeLLM addon that gives you a lot more flexibility in what endpoints to connect to (it supports OpenAI compatible endpoints, so TextGen WebUI, llama-cpp server and such all work). And it allows you to control prompting. You can make your own system prompt template using jinja for it.
It sends all info about your house as context to the LLM, so then the LLM brains kick in and it is able to interpret many fumbly commands, even if TTS misinterprets some words, it can still understand what you meant.
The downside is that it's an LLM so it may hallucinate. But that depends on what LLM you are running.
Running all of this on an RPi is not a good idea, even STT and TTS are all neural networks so RPi cant realistically handle them fast enough. With a decent GPU you can get it down to 1-2 seconds between request and reply, including local LLM.
Could you use to announce alerts, ie. If you had a fridge sensor that said the fridge temp was above 4 degrees C could this device audibly alert you , play an alert tone?
@1:43 Hilarious. Expect some weird guy to install this as a default response in the next software edition for the HA Voice Preview edition 🤣
Funny cuz that particular echo didn’t have a display either. Not even the clock display. But… I don’t understand the whole starting up a conversation with you randomly. I am kind of torn. I think a smart home should be in the background just doing its thing. But it should be able to do what you want. Personally I wouldn’t want a smart home randomly suggesting to me what I want… or don’t want. Preferences… maybe. But “hey it’s bright should I shut the shades?” If you wanted them shut wouldn’t you just ask it?
I’m pretty sure nothing leaves a Siri HomePod either. That’s a big reason why there’s such a huge variance of how smart each device is (HomePod Mini is dumber than an iPhone 15/16). Also a big reason why Siri seems so dumb, because they don’t have a huge mega server that’s getting smarter with every command.
Would the Jetson nano super be good for home assistant voice?
Was that agent cooper from twin peaks i saw? Nice!đź‘Ť
Does this also require SSL connection?
It's getting there… The Corporate world can't stop "We the People" if we stick together to help each other out on our own! This round is not for me … YET, but getting closer all the time. I'm against cloud anywhere… That's why we have Home Assistant!
I just wanna be able to say hey Jarvis instead of hey google or hey Alexa
So I see there's a few wake words offered by Home Assistant, but can you set up your own wake word using OpenWakeWord and use it with this device? As cool as Jarvis is, it's a little too common for voice assistants now in my opinion.
1:49 the crossover I didn't know I needed
Does it work in languages other than English?
Kinda bummed it doesn't have a POE option. Maybe in the future.
Honestly this is really cool and I love the fact that it has the option to integrate with things like ChatGPT since that actually means that it can process more complicated commands way easier and could even serve to have a lot more personalisation in the future especially if down the line it was able to implement functions like memories, I can also imagine that other LLMs that can be run locally will come out
Can you run a docker of the llm locally on a more powerful machine? That would be useful given the home assistant yellow is low powered
Now let’s see one for Hubitat.
Home assistant again 🤮
Heya! thanks for the review. Are there any other similar devices that work well with home assistant? I am looking to get rid of google home devices and place some microphone/speaker set-ups like this for commands only not listening to music or anything.
I just ordered one, I currently have an S3 Box and a couple of M5 Stack atoms, both work 'ok' but have days when they just ignore me.
I'm hoping this is a bit more reliable, and as you say its only going to get better. I'm really looking forward to Rhasspy speech next year.
All I need now is someone to produce a SBC designed to run local LLM's and just sip power until it's actually required to do some work.
I don't really want to have a PC with a GPU running 24/7 just for the occasions when I want to ask a question.
Open Source Master Race. OSMR, pleasing similar to ASMR
Thanks for bringing this to my attention. I've been try to build my own voice dohickey for home assistant. I do run a separate box for ollama host, with a 3090. There is a lower cost option to run ollama fairly fast on just a PI 5 with one of the AI Hats ($250) from Raspberry folks. I do use my ollama with GPU acceleration for ollama, for whisper, piper, and to even act as the AI attached to Home Assistant (and even have the voice from GladOs on it all). You really need to use the ollama as the AI for home assistant. https://www.youtube.com/watch?v=XvbVePuP7NY cover this well.
Actually having it do text to speech to trigger an Amazon Echo sounds like a legitimate workaround to some things.
I'm super excited about this. Google Generative AI's free tier works amazingly well as my HA's Voice Assistant, but the missing step was how to physically get it into the rooms of my house so that I could get rid of my Google Home devices. This looks like it will complete that step. Also, for total offline voice control, you could consider the newly announced Jetson Nano Super, a $250 AI board that can run some of the small LLMs. I haven't looked into the specifics of how that would work yet, but it's a lot of compute for not that much money and worth investigating.
Great review! I've been eager to see this device come out. Thanks again!
It may be that average users would expect it to understand more than it does out of the box, but you can still make it recognize different commands.
Give entities one or more aliases, and then it will know that you mean that one when you say it that way.