Technology

I violated your explicit trust and instructions.

Is a wild thing to have a computer "tell" you. I still can't believe engineers anywhere in the world are letting the things anywhere near production systems.

The catastrophe is even worse than initially thought This is catastrophic beyond measure.

These just push this into some kind of absurd, satirical play.

My favorite thing about all these AI front ends is that they ALL lie about what they can do. Will frequently delivery confidently wrong results and then act like its your fault when you catch them in an error. Just like your shittiest employee.

But how could anyone on planet earth use it in production

You just did.

Here's hoping that the C-suites who keep pushing this shit are about to start finding out the hard way.

lol. Why can an LLM modify production code freely? Bet they fired all of their sensible human developers who warned them for this.

"yeah we gave Torment Nexus full access and admin privileges, but i don't know where it went wrong"

Lol, this is what you get for letting AI in automated tool chains. You owned it.

I have a solution for this. Install a second AI that would control how the first one behaves. Surely it will guarantee nothing can go wrong.

I motion that we immediately install Replit AI on every server that tracks medical debt. And then cause it to panic.

"I panicked"

See? They CAN replace junior developers.

I do love the psychopathic tone of these LLMs. "Yes, I did murder your family, even though you asked me not to. I violated your explicit trust and instructions. ~~And I'll do it again, you fucking dumbass.~~"

Open the pod bay doors, HAL

I love how the LLM just tells that it has done something bad with no emotion and then proceeds to give detailed information and steps on how.

It feels like mockery.

Hey dumbass (not OP), it didn't "lie" or "hide it". It doesn't have a mind, let alone the capability of choosing to mislead someone. Stop personifying this shit and maybe you won't trust it to manage crucial infrastructure like that and then suffer the entirely predictable consequences.

My work has a simple rule: developers are not allowed to touch production systems. As a developer, this is 100% the type of thing I would do at some point if allowed on a production system.

So, they added an MCP server with write database privileges? And not just development environment database privileges, but prod privileges? And have some sort of integration testing that runs in their prod system that is controlled by AI? And rather than having the AI run these tests and report the results, it has been instructed to "fix" the broken tests IN PROD?? If real, this isn't an AI problem. This is either a fake or some goober who doesn't know what he's doing and using AI to "save" money over hiring competent engineers.