Hacked ‘AI Girlfriend’ Data Shows Prompts Describing Child Sexual Abuse : technology

[+] todd_bonzalez@lemm.ee 258 points 2 months ago* (last edited 3 weeks ago)

[deleted]

[-] emax_gomax@lemmy.world 72 points 2 months ago

I think the common incest fantasy in the west isn't too far removed from this too. Like all the actors are above age minimums but they pretend to be step kids or babysitters like these roles aren't commonly associated with children and older teens. It's clearly a form of deflection IMO.

[-] Melvin_Ferd@lemmy.world 22 points 2 months ago

Could also be that those are the only porns with even a half assed attempt at a plot instead of just opening with a ground and pound

[-] Kusimulkku@lemm.ee 19 points 2 months ago

even a half assed attempt at a plot

"I watch it for the plot, I wonder if they'll ever get her unstuck"

load more comments (1 replies)

load more comments (6 replies)

load more comments (13 replies)

[-] peanuts4life@lemmy.blahaj.zone 166 points 2 months ago

I actually don't think this is shocking or something that needs to be "investigated." Other than the sketchy website that doesn't secure user's data, that is.

Actual child abuse / grooming happens on social media, chat services, and local churches. Not in a one on one between a user and a llm.

[-] rottingleaf@lemmy.world 27 points 2 months ago

It's the "burn that witch" reaction.

See how they hate pedophiles and not child rapists.

The crowd wants to feel its power by condemning (and lynching if possible) someone.

I'd rather want to investigate those calling for "investigation" and further violation of privacy of people who for all we know have committed no crime.

That's about freedom of speech and yelling "fire" in a crowded theater and thousand hills radio, you know the argument.

load more comments (37 replies)

[-] rickdg@lemmy.world 73 points 2 months ago

insert surprised pikachu face here

[-] Soup@lemmy.cafe 35 points 2 months ago

Wait… so you meant to tell me that predatory simps are using AI incorrectly? Man…. If only someone could have called this years ago- something could have been done to minimize it!

Who knew that unchecked growth could lead to negative results?!

[-] yamanii@lemmy.world 26 points 2 months ago

But they did, AI Dungeon got nerfed so bad you could only have happy adventures with.

load more comments (6 replies)

[-] snek@lemmy.world 32 points 2 months ago

[removed by mod]

[-] BearGun@ttrpg.network 17 points 2 months ago

yea i don't have a problem with people with issues having non-harmful outlets for their urges, even though i might consider those outlets distasteful.

load more comments (2 replies)

[-] Xanis@lemmy.world 15 points 2 months ago

So it's less about outlets and more about progression. The concern is while plenty have an outlet they can use, we can't know how many also choose to escalate because of these outlets.

That said, I do agree with you. However, I will always be more for understanding the disorder when no act has occurred and finding treatment.

load more comments (2 replies)

[-] Kusimulkku@lemm.ee 31 points 2 months ago

Not at all surprising but also it is an AI

[-] Johanno@feddit.org 29 points 2 months ago

Ain't that what are the tools there for. I mean I don't like cp and I don't want to engage in way with people who like it. But I use those llms to describe fantasies that I wouldn't even talk about with other humans.

As long as they don't do it on real humans nobody is hurt.

[-] erwan@lemmy.ml 15 points 2 months ago

The problem with AI generated CP is that if they're legal, it opens a new line of defense for actual CP. You would need to prove the content is not AI to convince real abusers. This is why it can't be made legal, it needs to be prosecuted like real CP to be sure to convict actual abusers.

[-] daniskarma@lemmy.dbzer0.com 20 points 2 months ago* (last edited 2 months ago)

This is an incredibly itchy and complicated theme. So I will try not go go really further into it.

But prosecute what is essentially a work of fiction seems bad.

This it not even a topic new to the AI. CP has been wildly represented in both written and graphical media. And the consensus in most free countries is not to prosecute those as they are a work of fiction.

I cannot think why an AI written CP fiction is different from human written CP fiction.

I suppose "AI big bad" justify it for some. But for me there should be a logical explanation behind if we would began to prosecute works of fiction why some will be prosecuted and why other will not. Specially when the one that's being prosecuted is just regurgitating the human written stories about CP that are not being prosecuted nowadays.

I essentially think that a work of fiction should never be prosecuted to begin with, no matter the topic. And I also think that an AI writing about CP is no worse than an actual human doing the same thing.

load more comments (3 replies)

load more comments (9 replies)

[-] zlatiah@lemmy.world 29 points 2 months ago

A bit off topic... But from my understanding, the US currently doesn't have a single federal agency that is responsible for AI regulation... However, there is an agency for child abuse protection: the National Center on Child Abuse and Neglect within Department of HHS

If AI girlfriends generating CSAM is how we get AI regulation in the US, I'd be equally surprised and appalled

load more comments (1 replies)

[+] celsiustimeline@lemmy.dbzer0.com 14 points 2 months ago* (last edited 2 months ago)

[deleted]

load more comments (2 replies)

Technology

Our Rules

Approved Bots