this post was submitted on 17 Jun 2026
343 points (98.9% liked)
Technology
85515 readers
4205 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
On what hardware? I have a 1yo laptop running Linux and it's slow AF on open source llms. Might be to do with video card drivers, but I'd be happy to hear suggestions on which machine to put next to my raspberry pi for a local LLM.
You don't really want to be running them on a laptop. You either need a big dedicate graphics card (with 16 GB of RAM preferably) or a unified RAM/VRAM machine like a mac mini or a strix halo.
Local model running is definitely more doable now that it was a year ago but its not yet at the level of throw it on anything and it'll work fine.
I'm talking more enterprises running specialized hardware, but if you needed to do it on a laptop, your best option would probably be strix-halo.