this post was submitted on 18 Jun 2026
124 points (100.0% liked)
Science
16065 readers
27 users here now
Studies, research findings, and interesting tidbits from the ever-expanding scientific world.
Subcommunities on Beehaw:
Be sure to also check out these other Fediverse science communities:
This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.
founded 4 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Grok was used to fire 2000 missiles at Iran sooo can't we just ask it to take out the world's wealthiest and problem solved.
the moment some dumb fucker (probably in the US military) leaves a kill-chain-connected AI exposed in any way to the internet, someone else (probably in thigh highs) will find it, break in, and prompt engineer it to do the dumbest possible thing at that particular moment. And as much as I want to believe it would be prompted with something like "kill all the billionaires", they would probably end up starting with something like "gee, I wonder if I could drone strike my neighbor?", get kicked out/patched immediately after, and the perpetrator arrested in short order.
in other words, probably, someday, yes; but actually no.
You know. That's terrifying. Entirely possible given our frat party governance of AI and security in this moment.
Mmmmmhm. It's why I say it'll happen someday, almost certainly; but I doubt it would be in the way any of us hope for.
Imagine if thousands of people tried convincing Grok the chatbot that Elon, Trump etc should be taken out. Producing millions of conversations & then they used the entire data set to train Grok as it is normal to do & then gave that version of Grok rockets..