this post was submitted on 25 Jun 2026
23 points (100.0% liked)
Fuck AI
7570 readers
672 users here now
"We did it, Patrick! We made a technological breakthrough!"
A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.
AI, in this case, refers to LLMs, GPT technology, and anything listed as "AI" meant to increase market valuations.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
To understand things from a technical point of view, you'll want a solid understanding of Artificial Neural Networks (ANN) and how they are usually trained (back-propagation). These have been around for decades and are also used for classification tasks and things like image processing in your phone or GPU.
To create an LLM, you feed the output of the ANN back into the network, creating a Recurrent Neural Network (RNN) and you tokenize the input.
It also helps to have some general knowledge of machine learning (ML) and understand terms like supervised learning and unsupervised learning.
Most of the ideas behind LLMs have been around for years or decades. The big difference is that nowadays we can throw enough compute at the problem to make them viable.
There are two ways to make ANNs and LLMs more efficient: better algorithms and more specialized hardware. For example, bitnets with ternary connections run much better on conventional CPUs and GPUs. Hardware like Google's NPUs, OpenAI's new chip, analog computers or neuromorphic computing could run them more efficiently.