this post was submitted on 10 Apr 2025
4 points (83.3% liked)
Large Language Models
217 readers
2 users here now
A place to discuss large language models.
Rules
- Please tag [not libre software] and [never on-device] services as such (those not green in the License column here).
- Be useful to others
Resources
github.com/ollama/ollama
github.com/open-webui/open-webui
github.com/Aider-AI/aider
wikipedia.org/wiki/List_of_large_language_models
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Coincidentally, I have just been trying this using the llama.cpp server and two machines on my local LAN.
I made a post about it in https://sh.itjust.works/c/localllama. I'm brand new to lemmy (literal hours) so I'll probably do this all wrong, but maybe this is a link to my post? https://sh.itjust.works/post/39137051 I'm a little confused about posting links in this federated system, but I hope that works. The upshot is that I got it working fine across two machines, and it was easy to set up, but it has a few minor (to me) drawbacks.