this post was submitted on 21 Dec 2025
31 points (94.3% liked)
Fuck AI
6370 readers
1386 users here now
"We did it, Patrick! We made a technological breakthrough!"
A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.
AI, in this case, refers to LLMs, GPT technology, and anything listed as "AI" meant to increase market valuations.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Nah. Hallucinations are the LLM making shit up, without prompting or talking about irrelevant things. Especially in longer convos. GPT does this all the time now, unless you are very specific and repeat the constraints or clarifications. All of this is unprompted and not just “repeating” the statistical, or “working” pattern thar has the highest score.
Again, this is a feature of the fundamental structure of how LLMs work. What is determined to be the most statistically likely output is influenced not only by the training data itself but by the weights assigned during training.
LLMs can't make anything up because they do not know anything. Unexpected outputs likely become more common as the training data used is increasingly more the result of previous LLM outputs, intentionally poisoned data, and an increasing number of limitations are placed upon the models during training.