this post was submitted on 24 Jun 2026
137 points (81.3% liked)

Selfhosted

60526 readers
1151 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

Detailed Rules Post

  1. Be civil.

  2. No spam.

  3. Posts are to be related to self-hosting.

  4. Don't duplicate the full text of your blog or readme if you're providing a link.

  5. Submission headline should match the article title.

  6. No trolling.

  7. Promotion posts require active participation, with an account that is at least 30 days old. F/LOSS without a paywall has exceptions, with requirements. See the rules link for details.

  8. AI-related discussions and AI-involved promotional posts have additional requirements for tagging, as noted in Rule 7 and the AI & Promotional Post Expanded Rules post.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 3 years ago
MODERATORS
 

Do you host your own ML / AI / LLM? What do you use, and what do you use it for?

you are viewing a single comment's thread
view the rest of the comments
[–] irmadlad@lemmy.world 1 points 2 weeks ago* (last edited 2 weeks ago) (2 children)

I was thinking something along the lines of:

  • AMD Ryzen 9 9950X3D 4.3GHz
  • NVIDIA Tesla M10 Quad
  • 96GB DDR5
  • 4TB 990 EVO M.2

Which, with all the other accoutrements like water cooling, etc, will put me right at the $4k mark.

https://codeberg.org/BobbyLLM/picoGURU

I'll check it out.

[–] SuspiciousCarrot78@aussie.zone 1 points 2 weeks ago (1 children)

Nice bit of kit that. Very nice. Planning on serious AI shenanigans?

I'll check it out.

Cool. It's not ready any time soon but when it is, I'll announce it and make sure it's callable via SSH / terminal / OpenAI style chat end point.

That way you don't need anything fancier than a nice terminal to call it.

[–] irmadlad@lemmy.world 1 points 2 weeks ago

Planning on serious AI shenanigans

Absolutely. Like I said, if I'm going to do it, I want to do it up right. I don't want to come back in 5+ minutes for a result. LOL

[–] Natanox@discuss.tchncs.de 1 points 2 weeks ago (1 children)

Damn bro, you're treating yourself for sure! The RAM alone is what, 2k? 🥴

[–] irmadlad@lemmy.world 1 points 2 weeks ago

Well, I haven't had any new equipment in 15 years. I always buy used or refurb'd. I'm getting old. I figure, I've worked hard enough, might as well enjoy the fruits of my labor.