this post was submitted on 01 Jun 2026
54 points (63.6% liked)

Selfhosted

59697 readers
595 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

  1. Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.

  2. No spam posting.

  3. Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.

  4. Don't duplicate the full text of your blog or github here. Just post the link for folks to click.

  5. Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).

  6. No trolling.

  7. No low-effort posts. This is subjective and will largely be determined by the community member reports.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 3 years ago
MODERATORS
 

cross-posted from: https://sh.itjust.works/post/61139432

I seriously can't believe how much progress he's made for the FOSS community. He actually might take a bite out of the big 3's profits with this

you are viewing a single comment's thread
view the rest of the comments
[–] appauled@sh.itjust.works 38 points 5 days ago (4 children)

I kinda loved his "you should self host to decentralize from big tech" and "run graphene and Linux to avoid data collection" content, but idk what the local ai stuff is any good for

[–] EncryptKeeper@lemmy.world 27 points 5 days ago

It’s good for the same things machine learning has always been good for. Language synthesis and analysis. Selfhosting something like Paperless for document management. It actually has a very rudimentary learning engine for document classification for a long time but feeding document content to a local AI model for organization tagging is very useful.

[–] SuspiciousCarrot78@aussie.zone 2 points 3 days ago* (last edited 3 days ago) (1 children)

Quite a lot, actually.

Coding, document analysis, STT, home assistant, shopping assistant, gaming, journalling, image and video generation, OCR, language translation, recipe/meal / workout planning, study/flashcard generation, email drafting, adversarial review, search engine on steroids, hardware troubleshooter, companion for elder care, music curator and DJ ....

All of that without creepy ass cloud shit from Big AI.

I can go on, but "a lot" probably covers it.

EDIT: asked, answered and...down voted. Classic Lemmy anti-ai knee jerk. FWIW I work with AI in healthcare settings as well as code review for my own personal projects.

What I said are actual use cases, not a wishlist generated by Jippity. I can elaborate on any and all of them with actual real life experience.

[–] appauled@sh.itjust.works 1 points 19 hours ago

Coding is okay, but the flagship free models usually crush whatever and to have decent memory you need hella VRAM Doc analysis is okay if they're small, Home assistant isn't bad but kinda overkill with an LLM when you can just set manual automations, Journalling, gaming, music, DJ'ing, elder care, imagine and video generation, are all relatively bad even on flagship models

Quick overview of searches is fine but I'll use a free flagship model for that, in depth research tends to not be great

[–] dropped_the_chief@lemmy.world 2 points 4 days ago (1 children)

If you use AI for a lot of small things, then you can offload the tasks to a locally run server.

Or if you see it as a feature you plan on using for a long time and don't want to have to keep paying big tech for the privilege of using AI, and hell, you already have a nice graphics card, it's perfect.

[–] plant@lemmy.dbzer0.com 1 points 4 days ago

Even Jensen calls it LLM

[–] daniskarma@lemmy.dbzer0.com 2 points 4 days ago

It's great for solo roleplaying.

I mean. Not great. But it's something you can interact with in a way that's not possible without other people. So that's something.