35

Are there any free/open-source TTS options out there that are on the same level as Google Cloud's? I tried a lot of free ones, but they are absolutely awful and still sound like my Amiga did 30 years ago. With LLMs being available as open source, I am hoping there's also a good TTS offering I just haven't found yet.

top 14 comments
sorted by: hot top controversial new old
[-] tal@lemmy.today 11 points 10 months ago* (last edited 10 months ago)

Festival -- not cutting edge -- will definitely be better than your Amiga, and can handle long text. Last time I set it up, IIRC I wanted some voices generated by Tokyo University or something, which took some setting up. It'll probably be packaged in your Linux distro.

You can listen to a demo here.

https://www.cstr.ed.ac.uk/projects/festival/onlinedemo.html

It's not LLM-based.

For short snippets, offline, one can use Tortoise TTS -- which is LLM based. But it's slow and can only generate clips of a limited length. Whether it's reasonable for you will depend a lot on your application. It will let one clone -- or make a voice sounding more-or-less similar -- a voice using some sound samples from them speaking.

https://github.com/neonbjb/tortoise-tts

Examples at:

https://nonint.com/static/tortoise_v2_examples.html

I haven't used Google's, but I'd assume, given that Google is paying people to work on it full time, that whatever they've done probably sounds nicer. But, then not open source, so...shrugs

[-] state_electrician@discuss.tchncs.de 2 points 10 months ago

Ah, I looked at Tortoise, but I do not have an nVidia GPU, so I couldn't try it. Festival I tried and the results were bad. Not so much for the voice, but for intonation and pronunciation.

[-] tal@lemmy.today 4 points 10 months ago* (last edited 10 months ago)

Ah, I looked at Tortoise, but I do not have an nVidia GPU, so I couldn’t try it.

I use it on an AMD GPU.

EDIT: Wait, let me make sure. I was using an Nvidia GPU for a while and switched to AMD.

EDIT2: Oh, yeah, it uses transformers, and that doesn't work on rocm presently, IIRC.

[-] observantTrapezium@lemmy.ca 9 points 10 months ago

Piper is my choice. Very easy to use from the command line, fairly good sounding voices. Prior to that, for years (decades?) I used espeak-ng, had a very robotic voice but articulated almost everything very clearly, and I got used to it so didn't actually mind.

[-] Voroxpete@sh.itjust.works 3 points 10 months ago

Came here to recommend Piper. It's an excellent TTS engine.

[-] tetris11@lemmy.ml 1 points 10 months ago

Espeak doesn't get better, but nor does it get worse

[-] bastion@feddit.nl 1 points 10 months ago
[-] impersonator@lemmy.ml 9 points 10 months ago
[-] state_electrician@discuss.tchncs.de 3 points 10 months ago

Yes, but if you compare it to https://cloud.google.com/text-to-speech?hl=en (scroll down a bit and you can try it) and the Neural2 model, it sounds like shit. I mean, it's great to see that there are efforts, but it just pales in comparison.

[-] bastion@feddit.nl 1 points 10 months ago

Well, it's about as good as you're going to get right now.

[-] pythia@lemmy.dbzer0.com 5 points 10 months ago* (last edited 10 months ago)
[-] state_electrician@discuss.tchncs.de 2 points 10 months ago

Cool, I'll give those a try!

[-] NarrativeBear@lemmy.world 2 points 10 months ago

Balabolka was/is my go to for TTS. It creates audio files as well for later if you need. Used it to make plenty of audio books in the past.

[-] filister@lemmy.world -1 points 10 months ago

I would say Elevenlabs is the best but unfortunately not free.

If you need it for a short while it might be worth it.

I tried Piper with different models, and a couple of FOSS alternatives but the output quality was definitely subpar.

I would say soon we will have good FOSS models, but for the time being that's not the case.

this post was submitted on 13 Nov 2023
35 points (90.7% liked)

Selfhosted

39143 readers
264 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

  1. Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.

  2. No spam posting.

  3. Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.

  4. Don't duplicate the full text of your blog or github here. Just post the link for folks to click.

  5. Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).

  6. No trolling.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 1 year ago
MODERATORS