In case you missed it, ChatGPT 5.1 had a tendency to talk about "goblins" in its responses. Supposedly this was a result of training a "nerdy" personality, but it bled into the model as a whole. Because the training run for the latest model already had this flaw, they had to add specific instructions to the system prompt for their Codex coding tool to avoid this behaviour.
Here's the full prompt from their github. In fact, they repeated the goblin instructions twice, cos you know that will definitely fix it. It's an interesting read if you consider each one of these instructions were meant to prevent some undesired behaviour: https://paste.sh/Iev3HtMe#JZ4dw_CkvJcpVmjjoy7WZnSn
More info here: https://news.northeastern.edu/2026/05/06/chatgpt-goblins-problem-ai-behavior/
OpenAI's own blog post casually explaining why they couldn't predict that their state of the art model would obsess about goblins: https://openai.com/index/where-the-goblins-came-from/
Not GPT5.1 though lol
Yeah. It's proprietary. And you can't modify the Windows 11 source code, either.
But Microsoft can modify the Windows 11 source code. Or at least they used to be able to, before AI.
OpenAI should be able to re-train its poorly trained model. But of course it can't, that would take months, maybe years of datacenter time.
Now OpenAI since can't even re-train their own models, they resort to chastising it in its own system prompt.
This is the problem. If you're trying to imply this is normal and expected, it shouldn't be. It needs not to be. We cannot accept this as the normal way of doing things going forward. It is awful, and painfully stupid.
Not with that attitude!
Windows 11 isn't running in the cloud yet though. Unless it checks to make sure it hasn't been tampered with too much you should just be able to modify some of its binaries (the source code obviously isn't available). With the cloud based llms that is not possible.
If you have a model on your computer you can retrain it, which is like changing a binary just far less precise. The option of having a source code equivalent just isn't there beyond having the same dataset and seeds for the training program.
So I'd say it is worse than your average run of the mill proprietary software.