this post was submitted on 27 Jan 2026
30 points (89.5% liked)

Firefox

6520 readers
79 users here now

A community for discussion about Mozilla Firefox.

founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] j4k3@piefed.world 3 points 1 day ago

Let me know when they create an alternative to transformers, pytorch, and create a tokenizer without the Open AI QKV hidden layers of alignment. That is where all the fuckery is happening. This is standard and used for all models. It is totally proprietary and a primary reason why they are "open weights" but not Open Source.