this post was submitted on 16 Jan 2026
13 points (93.3% liked)

technology

24279 readers
294 users here now

On the road to fully automated luxury gay space communism.

Spreading Linux propaganda since 2020

Rules:

founded 5 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[โ€“] Korkki@lemmy.ml 6 points 1 month ago (1 children)

Just the scale of hardware needed to run LLMs is really prohibitive of FOSS. Even things like deepseek are not really in the real of realistic self hosting. We need some hardware advancement or for the bubble to pop and hardware prices to come down before that.

I do agree with the general premise. Total AI rejection is luddite bullshit.

[โ€“] yogthos@lemmygrad.ml 7 points 1 month ago

Smaller models have been getting a lot more capable of late. A 32 billion param model can do quite a bit today, and there are a lot of things that can still be optimized going forward. If you look at capability improvements, it's absolutely stunning, something you can run on a laptop today would've needed a whole data centre just a couple of years ago.