this post was submitted on 17 Jun 2026
181 points (97.4% liked)
Technology
85515 readers
4206 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Why would a developer likely have a high end GPU? Writing code doesn’t use a GPU.
There is a significant overlap between developers and gamers.
Most developers use their work provided machines, which aren’t gaming machines with giant GPUs because again, GPUs don’t help development at all.
Also developers often want more ram, and if youre on the mac side, the M series ram works as video ram for loading and running models, so there's a good chance you can already run something better than is typical of others, and apple is focusing on this by adding more NPUs and increasing memory bandwidth. They arent good at training, but can do inference.
I’m on a MacBook with M2, 32GB ram. Literally just tried:
Well, I guess I’ll try again next year.
For context: my home pc is running gemma4:31b just fine. It’s also a beefy ass desktop, though.
You might be doing something wrong, models that size shouldn't be that slow if properly configured on a 32gb m2
You need a metal optimized client and model, not the same models you'd run on your desktop machine.