this post was submitted on 02 Jul 2026
670 points (99.4% liked)
Fuck AI
7564 readers
827 users here now
"We did it, Patrick! We made a technological breakthrough!"
A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.
AI, in this case, refers to LLMs, GPT technology, and anything listed as "AI" meant to increase market valuations.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
A token can range from individual letters to several words in a stock phrase, from what little I understand. It's a piece of whatever they're doing behind the scenes leaking into the public-facing terminology.
According to my SO, it's safe enough to just say "a token is a word" as long as you remember this is only an approximation.