this post was submitted on 18 May 2026
10 points (100.0% liked)

AI

6427 readers
20 users here now

Artificial intelligence (AI) is intelligence demonstrated by machines, unlike the natural intelligence displayed by humans and animals, which involves consciousness and emotionality. The distinction between the former and the latter categories is often revealed by the acronym chosen.

founded 5 years ago
 

The change is a result of MTP support landing in llama.cpp. The Qwen3.6 Unsloth GGUFs are now out of experimental mode, with llama.cpp has merged many PRs, and MTP is now properly supported in Unsloth.

https://unsloth.ai/docs/models/qwen3.6#mtp-guide

top 6 comments
sorted by: hot top controversial new old
[–] kmartburrito@lemmy.world 4 points 1 day ago (1 children)

I've been using qwen3.6 35b since it came out with really good results, this is a cherry on top. Thanks for sharing!

[–] yogthos@lemmy.ml 3 points 1 day ago (1 children)

I find it's the first model I can run locally that actually feels genuinely useful for coding. I'm really excited about what things might look like in another year. We might really get current frontier model performance on a laptop at this rate.

[–] kmartburrito@lemmy.world 2 points 13 hours ago

Unfortunately the new MTP model doesn't work yet with my LM Studio + Claudish + Claude Code setup. Will need to wait for support to be merged into the lm Studio ROCm llama.cpp runtime.

[–] yogthos@lemmy.ml 4 points 1 day ago* (last edited 1 day ago) (1 children)

@davel@lemmy.ml the requirements for running Qwen just got significantly lower, it's basically the best local model at the moment

[–] davel@lemmy.ml 3 points 1 day ago (1 children)

Thanks. I haven’t bought hardware to run things locally yet. I did buy some DeepSeek tokens this weekend to play around with. Maybe I should rent until the bubble pops and then buy a supercomputer at fire sale prices.

[–] yogthos@lemmy.ml 4 points 1 day ago

Oh yeah, that's definitely the best approach if you don't already have the hardware since DeepSeek is just absurdly cheap to use. Eventually, hardware prices are going to come down, and local models are going to keep getting more efficient too. So, dumping a few grand on a rig right now doesn't really make much sense.