this post was submitted on 17 Jun 2026
186 points (97.0% liked)

Technology

85515 readers
4205 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] partofthevoice@lemmy.zip 1 points 9 hours ago (1 children)

I’m on a MacBook with M2, 32GB ram. Literally just tried:

  • gemma4:12b - very slow, unworkable
  • qwen3:8b - very slow, unworkable
  • qwen2.5-coder:7b - slow but workable. Doesn’t use tools properly in OpenCode.

Well, I guess I’ll try again next year.

For context: my home pc is running gemma4:31b just fine. It’s also a beefy ass desktop, though.

[–] NotMyOldRedditName@lemmy.world 2 points 9 hours ago* (last edited 8 hours ago)

You might be doing something wrong, models that size shouldn't be that slow if properly configured on a 32gb m2

You need a metal optimized client and model, not the same models you'd run on your desktop machine.