this post was submitted on 09 Dec 2025
78 points (100.0% liked)

World News

1857 readers
808 users here now

Rules:
Be a decent person.
No racism, sexism, ableism, homophobia, transphobia, zionism/nazism, and so on.

Other Great Communities:

Rules

Be excellent to each other

founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] nymnympseudonym@piefed.social 0 points 2 months ago (2 children)

Most frontier models since GPT4 actually use synthetic pre-training data , before slurping up the Internet and after along with RLHF

~~too many fingers~~ sausage fingers

[–] nymnympseudonym@piefed.social 1 points 2 months ago

Also training data is totally independent of chip feature size, interconnects, memory bandwidth, and all the things actually relevant to chips