this post was submitted on 24 Jun 2026
137 points (81.3% liked)

Selfhosted

60664 readers
698 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

Detailed Rules Post

  1. Be civil.

  2. No spam.

  3. Posts are to be related to self-hosting.

  4. Don't duplicate the full text of your blog or readme if you're providing a link.

  5. Submission headline should match the article title.

  6. No trolling.

  7. Promotion posts require active participation, with an account that is at least 30 days old. F/LOSS without a paywall has exceptions, with requirements. See the rules link for details. Tags [CBH] or [AIP] are required, see the links in Rule 8 for details.

  8. AI-related discussions and AI-involved promotional posts have additional requirements for tagging, as noted in Rule 7 and the AI & Promotional Post Expanded Rules post, and find example disclosures here.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 3 years ago
MODERATORS
ruud@lemmy.world
Loki@lemmy.world
CannaVet@lemmy.world
devve@lemmy.world
ayyy@sh.itjust.works
curbstickle@anarchist.nexus
curbstickle_lw@lemmy.world
137
Do you host your own AI? (aussie.zone)
submitted 2 weeks ago by SuspiciousCarrot78@aussie.zone to c/selfhosted@lemmy.world
205 comments fedilink hide all child comments
 

Do you host your own ML / AI / LLM? What do you use, and what do you use it for?

you are viewing a single comment's thread
view the rest of the comments
[โ€“] SuspiciousCarrot78@aussie.zone 1 points 2 weeks ago* (last edited 2 weeks ago) (1 children)

Yeah, I've heard the B70 is good bang for buck. My kids love using chat GPT to generate images and I'm aware that there are some really capable local models that can do that as well now - B70 should make short work of it.

That may be something for me to look at later on if I decide to keep self hosting.

OTOH, I'm also aware that I may end up building something that they don't actually use. Been there, done that, and I don't want to do it again.

Actually, on that topic, one interesting use case for me is my youngest one wants to have a YouTube channel.

So obviously, I'm not going to let her become a YouTuber, but what I'm thinking of doing is providing her my old phone (properly locked down) so that she can video record clips of what she wants.

Then - have those clips sent automatically to our jellyfin server so it appears like a channel. Code a fake YT plugin so that AI can do likes, positive comments etc.

It's... work. I dunno...maybe a good enough AI can vibe code the entire project for me.

[โ€“] rando@lemmy.ml 1 points 2 weeks ago

I've been testing coding capabilities a bit (mostly scripts - so that work done by ai is reproducible).

  1. Context size is very much a required thing along with model capabilities.
  2. Local model can generate good enough script in one shot - but reiterations r crazy
  3. Use git to keep files tracked (easy to revert) and make a modular script - main script calls function a, function b etc where functions are relatively self contained (no need to look at others) when u need new capability add function c
  4. If something need changing- try to do it urself (unless it's whole architectural change, then just start new project)

As for image gen + chat . as long as chat model + context + image model fits, u should be fine.