294
submitted 10 months ago by pluja@lemmy.world to c/selfhosted@lemmy.world

Hi everyone!

A few days ago I released Whishper, a new version of a project I've been working for about a year now.

It's a self-hosted audio transcription suite, you can transcribe audio to text, generate subtitles, translate subtitles and edit them all from one UI and 100% locally (it even works offline).

I hope you like it, check out the website for self-hosting instructions: https://whishper.net

top 27 comments
sorted by: hot top controversial new old
[-] webghost0101@sopuli.xyz 18 points 10 months ago

Does this need to connect to openai or does it function fully independently? Its for offline use.

[-] pluja@lemmy.world 23 points 10 months ago

No, it's completely independent, it does not rely on any third-party APIs or anything else. It can function entirely offline once the models have been downloaded.

[-] pcouy@lemmy.pierre-couy.fr 11 points 10 months ago

The readme mentions "transcription time on CPU" so it's probably running locally

[-] fmstrat@lemmy.nowsci.com 10 points 10 months ago

How does it compare to https://github.com/guillaumekln/faster-whisper?

I've been using Faster Whisper for a while locally, and its worked out better than raw whisper and benchmarks really well. Just curious if there are any reasons to switch.

[-] pluja@lemmy.world 20 points 10 months ago

Whishper uses faster-whisper in the backend.

Simply put, it is a complete UI for Faster-Whisper with extra features like transcription translation, edition, download options, etc...

[-] fmstrat@lemmy.nowsci.com 2 points 10 months ago

Nice! Thanks.

[-] ares35@kbin.social 8 points 10 months ago

how does whisper do transcribing technical documents. like for lawyers, doctors, engineers and what not? or speakers with heavy accents?

[-] pluja@lemmy.world 9 points 10 months ago

Whisper models have a very good WER (word error ratio) for languages like Spanish, English, French... if you use the english-only models it also improves. Check out this page on the docs:

https://whishper.net/reference/models/#languages-and-accuracy

[-] micha 7 points 10 months ago

Congratulations on the launch and thanks for making this open-source! Not sure if this supports searching through all transcriptions yet, but that’s what I’d find really helpful. E.g. search for a keyword in all podcast episodes.

[-] pluja@lemmy.world 6 points 10 months ago

That's a great idea! I'll attempt to implement that feature when I find some time to work on it.

[-] Axiochus@lemmy.world 6 points 10 months ago

Oh, awesome! Does it do speaker detection? That's been one of my main gripes with Whisper.

[-] pluja@lemmy.world 7 points 10 months ago* (last edited 10 months ago)

Unfortunately, not yet. Whisper per se is not able to do that. Currently, there are few viable solutions for integration, and I'm looking at this one, but all current solutions I know about need GPU for this.

[-] jherazob@kbin.social 2 points 10 months ago

VERY understandable, requiring a GPU would limit it's application and spread, i hope a good GPU-less solution is found eventually

[-] midas@ymmel.nl 5 points 10 months ago

Awesome will give this a try

[-] rikudou@lemmings.world 5 points 10 months ago* (last edited 10 months ago)

Nice, congrats!

a meme with a photo of Richmond Valentine from Kingsman, the bottom text says whishper

[-] optissima@lemmy.world 4 points 10 months ago

I am looking for open source live transcription software, does this offer that, or is it only file-based?

I saw your project on Codeberg before. Then it was whisper plus. Since whisper+ it did not work anymore for me. I uploaded a file and it did not start. The old whisper worked. Did not try it for months anymore with whisper plus.

Maybe I give it another try. Can I use bind mounts or are there special permissions? Anyway thanks for your work.

[-] pluja@lemmy.world 6 points 10 months ago

Whisper+ had some problems, that's why I rewrote everything. This new version should fix almost (maybe there are some bugs I haven't found) everything.

If you take a look at the docker-compose file, you'll see it is already using bind mounts. The only special permission needed is for the LibreTranslate models folder, which runs as non-root with user 1032.

[-] UberMentch@lemmy.world 3 points 10 months ago* (last edited 10 months ago)

Would love to deploy this, but unfortunately I'm running server equipment that apparently doesn't support MongoDB 5 (Error message MongoDB 5.0+ requires a CPU with AVX support, and your current system does not appear to have that!). Tried deploying with both 4.4.18 and 4.4.6 and can't get it to work. If anybody has some recommendations, I'd appreciate hearing them!

Edit: Changed my proxmox environment processor to host, fixed my issue.

[-] pluja@lemmy.world 1 points 10 months ago

I'm glad you were able to solve the problem, I add the comment I made to another user with the same problem:

Didn't know about this problem. I'll try to add a MariaDB alternative database option soon.

[-] obinice@lemmy.world 3 points 10 months ago

I've been looking for a tool to do this for YEARS, my god! Years!!! ❤️❤️

[-] Railcar8095@lemm.ee 3 points 10 months ago

Massive kudos. I had the need for something like this in the past and it would have been a blessing.surely it will be for somebody else

[-] tvcvt@lemmy.ml 2 points 10 months ago

This is excellent timing for me. I was just taking a break from working on setting up whisper.cpp with a web front end to transcribe interviews. This is a much nicer package than I ever had a chance of pulling together. Nice work!

[-] orizuru 2 points 10 months ago

Congrats, and thank you for releasing this!

Maybe there's a couple of personal projects I could use it for...

[-] crazygoat@lemmy.world 1 points 6 months ago

Even this is an good sound to text converter and a good ai transcription service

[-] Konraddo@lemmy.world 1 points 10 months ago

Just tried this out but couldn't get it to work until downgrading mongo to 4.4.6 because my NAS doesn't ha``ve AVX support. But then, mongo stays unhealthy. No idea why.

[-] pluja@lemmy.world 1 points 10 months ago

Didn't know about this problem. I'll try to add a MariaDB alternative database option soon to solve this.

this post was submitted on 28 Aug 2023
294 points (98.4% liked)

Selfhosted

37915 readers
338 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

  1. Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.

  2. No spam posting.

  3. Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.

  4. Don't duplicate the full text of your blog or github here. Just post the link for folks to click.

  5. Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).

  6. No trolling.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 1 year ago
MODERATORS