this post was submitted on 09 Dec 2025
78 points (100.0% liked)
World News
1857 readers
739 users here now
Rules:
Be a decent person.
No racism, sexism, ableism, homophobia, transphobia, zionism/nazism, and so on.
Other Great Communities:
Rules
Be excellent to each other
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Not ones to compete with NVidia Not ones that will train GPT5/6/7
The.... That's not
Enough data to train a hypothetical gpt6 literally does not exist.
Most frontier models since GPT4 actually use synthetic pre-training data , before slurping up the Internet and after along with RLHF
~~too many fingers~~ sausage fingers
Also training data is totally independent of chip feature size, interconnects, memory bandwidth, and all the things actually relevant to chips