A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.
Rules:
Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.
No spam posting.
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.
Don't duplicate the full text of your blog or github here. Just post the link for folks to click.
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
No trolling.
No low-effort posts. This is subjective and will largely be determined by the community member reports.
Resources:
Any issues on the community? Report it using the report flag.
Questions? DM the mods!
https://github.com/resemble-ai/chatterbox is pretty good, and has both TTS and voice cloning. Main disadvantage for me was that even if the cloning gives a consistent voice, the generated samples can get random accents.
https://huggingface.co/zai-org/GLM-TTS also seemed pretty promising, but I haven't had time to test it yet.
https://github.com/marytts/marytts
I've used MaryTTS semi-recently. It's older but works well enough for my cases. I have it running on a server (locally) and my endpoints make a call to it and playback the returned audio file.
On Android, I use SherpaTTS which has good voices, but I'm not aware of a desktop/Linux option. It mentions using voices from Coqui which you linked, so I would guess that would be the way to go for desktop.
SherpaTTS is great on GrapheneOS with OSM for navigation.
I'm using it with CoMaps, freaking great.
+1 for this.
Sherpa links to this page, if anyone wants to preview what the voices sound like
https://huggingface.co/spaces/k2-fsa/text-to-speech
From the ones I've tried so far, csukuangfj/vits-piper-en_US-amy-medium|1 speaker sounded the most clear and natural for GPS / driving directions. If someone finds other good ones, I'd appreciate it :)
Piper just moved to https://github.com/OHF-Voice/piper1-gpl
It's fine, and it's probably the best TTS you're going to run locally.
Tbh I generally prefer that robot voices actually sound like robots. I don't want human sounding TTS since I don't like anthropomorphized machines. So I'd stay with something low tech.
100%. It irks when software has messages in the first person. The human-like TTS are very uncanny valley to me.
I needed voice over for a video recently and everyone is telling me to use AI, I tried dozens and they'll all just off. Ended up getting a friend to record it. I don't have a decent mic so my own recording sounded bad.
I went back from SherpaTTS to eSpeak because I liked the robot woman better. She's easy to understand, takes up 5 mb on my phone and it's a fun conversation starter.
Kokoro is your best bet right now. It works wonderfully even in a docker container with no GPU. There are others but I don’t have the list right now. Will throw another update on here when I do.
The rhasspy guy was very invested in Coqui. He built a lot of his own stuff, for his home automation and such. But Coqui was superior, so he started spending time on that.
Unfortunately, the coqui team (based out of Mozilla) was very distracted and didn’t ship a lot of stuff on time or at all. It doesn’t even have basic stuff like SSML support right now, if I recall correctly. So the rhasspy guy also lost steam.
Of course, with the OpenAI model of audio generation, you’re expected to not use SSML at all and just use the black box API to get “good enough” results. That really sucks.
Oh, I just remembered which other one I wanted to mention - someone has built an open source version of NotebookLLM, complete with multi voice support. But it requires GPU, I believe. Do what you will with that. I’ll add a link if I find it.
I prefer kokoro because it’s really solid and works really well on CPU.
I'm guessing this is what you're talking about?
I dont think so. This one doesn’t have any code or implementation details. The one I saw was fully installable but a PITA.
Here is the repo for the piper I use, https://github.com/OHF-Voice/piper1-gpl
For my phone, I use this tts engine, https://k2-fsa.github.io/sherpa/onnx/tts/apk-engine.html
What’s your workflow on your phone?
I have kaldi auto updated with my preferred voice when ever there is a new release via obtainium.
I set kaldi as my tts engine, and I disabled the google TTS.
Then anytime I use TTS on my phone it uses kaldi.
Its been really great for my preferred eBook reader (Librera) so I can do chores and read at the same time.
That’s an excellent setup! I’ll try to replicate it when I get home!
I highly recommend Mlx-audio for anyone doing tts on Apple Silicon. It offers great performance, leverages kokoro-82M, and plays well with streaming frontends like Open webui. The one shot voice cloning feature is also pretty cool.
Kokoro was the one I was going to mention. I played around with it a bit, was very impressed with the speed and quality. And then I realized I had been using it in CPU mode. GPU is incredible.
That looks amazing! Will check it out. Love Kokoro and love how good Apple Silicon is!
Try alltalk_tts v2. One of the features is you can provide an audio sample and the AI will imitate the voice. The overall quality is pretty good, if you choose a larger model and let it run.
Ooh! Has anyone managed to do this with Majel Barrett's (the Enterprise computer) voice yet?
It really depends on what you want to do with it. I run wyoming-piper as part of my Home Assistant deployment and its been rock solid. The Wyoming protocol is pretty well documented too, so you should be able to integrate with it pretty easily.
None of this may be relevant, but I'm curious what your use case is. I use TTS very extensively to consume media and have my preferences. None of them are open source, but as far as I know all operate locally, though they're baked into other programs like screen readers and ebook readers.
I prefer older more robotic voices because they remain intelligible at high speed. Eloquence is a favorite, as are the older Apple voices like Fred and Ralph. I think it has gone by other names but TruVoice (spacing and capitalization may vary) is also up there. It was semi popular during the surreal meme era. Another memetic synth that's a little before my time but I quite enjoy is DECTalk (AKA the Moonbase Alpha voice). I believe Vocalizer was responsible for the OG Siri voice Samantha and that one's a more human voice that's still serviceable at high speeds.
Save that post for the next time when someone with too much time on their hands asks what project they should start/contribute to.
Faster Whisper could be a option, there is various GUI options available as well.
https://github.com/SYSTRAN/faster-whisper
And if you are looking for something that you can "just install", I recommend balabolka. The voices are natural and you can use some of the windows built in voices to make it more natural.
https://www.cross-plus-a.com/balabolka.htm
Make Azure natural TTS voices accessible to any SAPI 5-compatible application.
Not sure what you're asking here, but are you talking about the voice part, the TTS pat, or the interaction?
I'm curious how could it be unclear that this post is about the TTS part? Espeak is provided as an example.