Selfhosted

60644 readers

559 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

Detailed Rules Post

Be civil.
No spam.
Posts are to be related to self-hosting.
Don't duplicate the full text of your blog or readme if you're providing a link.
Submission headline should match the article title.
No trolling.
Promotion posts require active participation, with an account that is at least 30 days old. F/LOSS without a paywall has exceptions, with requirements. See the rules link for details. Tags [CBH] or [AIP] are required, see the links in Rule 8 for details.
AI-related discussions and AI-involved promotional posts have additional requirements for tagging, as noted in Rule 7 and the AI & Promotional Post Expanded Rules post, and find example disclosures here.

Resources:

selfh.st Newsletter and index of selfhosted software and apps
awesome-selfhosted software
awesome-sysadmin resources
Self-Hosted Podcast from Jupiter Broadcasting

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 3 years ago

MODERATORS

curbstickle@anarchist.nexus

curbstickle_lw@lemmy.world

137

Do you host your own AI? (aussie.zone)

submitted 2 weeks ago by SuspiciousCarrot78@aussie.zone to c/selfhosted@lemmy.world

205 comments fedilink hide all child comments

Do you host your own ML / AI / LLM? What do you use, and what do you use it for?

you are viewing a single comment's thread
view the rest of the comments

[–] rando@lemmy.ml 1 points 2 weeks ago

I've been testing coding capabilities a bit (mostly scripts - so that work done by ai is reproducible).

Context size is very much a required thing along with model capabilities.
Local model can generate good enough script in one shot - but reiterations r crazy
Use git to keep files tracked (easy to revert) and make a modular script - main script calls function a, function b etc where functions are relatively self contained (no need to look at others) when u need new capability add function c
If something need changing- try to do it urself (unless it's whole architectural change, then just start new project)

As for image gen + chat . as long as chat model + context + image model fits, u should be fine.