this post was submitted on 09 Dec 2025
78 points (100.0% liked)

World News

1857 readers
739 users here now

Rules:
Be a decent person.
No racism, sexism, ableism, homophobia, transphobia, zionism/nazism, and so on.

Other Great Communities:

Rules

Be excellent to each other

founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] cassandrafatigue@lemmy.dbzer0.com 3 points 2 months ago (1 children)

The.... That's not

Enough data to train a hypothetical gpt6 literally does not exist.

[–] nymnympseudonym@piefed.social 0 points 2 months ago (2 children)

Most frontier models since GPT4 actually use synthetic pre-training data , before slurping up the Internet and after along with RLHF

~~too many fingers~~ sausage fingers

[–] nymnympseudonym@piefed.social 1 points 2 months ago

Also training data is totally independent of chip feature size, interconnects, memory bandwidth, and all the things actually relevant to chips