this post was submitted on 12 Jul 2026
365 points (99.5% liked)
Fuck AI
7613 readers
1279 users here now
"We did it, Patrick! We made a technological breakthrough!"
A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.
AI, in this case, refers to LLMs, GPT technology, and anything listed as "AI" meant to increase market valuations.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
That’s just not gonna happen. Inference is incredibly expensive, and training is even more expensive. There’s not a lot that can be done to change that.
~Just use smaller models, my guy. Humans are so easy to replace, a 30b model running on an old RTX 3080 ought to do it, right?~
But the fun thing about the scenario of open source/light weight models dominating. Is the fact all of the leading LLM companies would go belly up, it's the biggest bear take on Anthropic, OpenAi and the likes - They need to have people use the biggest, most expensive models they can't run themselves, that's their entire claim to trillion
30B models are no featherweight at all and an old 3080 won't be able to lift them due to insufficient RAM and even if it did, low bandwidth would make it so you'd only be able generate a few dozens of tokens per minute.
This message alone would take like 2 minutes to generate.