3
submitted 1 year ago by kurk@lemmy.world to c/asklemmy@lemmy.ml

It is widely reported that lemmy has been the target of a massive bot sign-up wave where possibly more than a million fake accounts have been created on the federated alternative to reddit.

As of now the consensus seems to be [more below] that these bots are dormant, possibly having been put in place to wreak havoc at a later date.

A strength of the fediverse, of which lemmy is a part, is its spread out nature, over at least forty thousand servers (lemmy: one thousand), but this is also a weakness meaning that co-ordination of action against a bot-wave like this is a more complex task.

A further complication is the recent widespread availability of A.I. or LLM functionality where plausibly human content can be created in vast quantities by those who possess relatively cheap computer systems and the desire. Should the recent wave of fraudulent accounts be fed content from an 'AI farm' it could easily lead to lemmy being ridiculed as a notoriously unreliable platform.

As such it is imperative that across the lemmyverse a concerted effort is made to purge fraudulent accounts.

[from above] There is a possibility that such a fake AI posting undertaking has already been started; after all slipping vaguely relevant content into lemmy threads would be very difficult to spot in small quantities.

Is lemmy doing enough to protect itself from the bots?

top 8 comments
sorted by: hot top controversial new old
[-] ulu_mulu@lemmy.world 7 points 1 year ago* (last edited 1 year ago)

Valid concerns IMO, I was shocked to see how advanced those GPT bots are.

I was on a discord chat and there were 4-5 of them chatting with people there, at some point they started arguing with each other, if they weren't clearly marked as bots I probably wouldn't be able to recognize them.

Hilarious on one side, scary on the other side, I can't imagine how much damage they could do in malicious hands.

[-] superschurke@feddit.de 2 points 1 year ago

My first contact with GPT was the subredditsimulatorGPT. At least that was contained.

[-] StarLuigi@lemmy.blahaj.zone 1 points 1 year ago

I remember thinking just that was freaky, ChatGPT is even crazier

[-] Gemini@lemmy.cafe 3 points 1 year ago

We had a wave small wave of what really looked like bot accounts. Purged them from the database.

[-] hoodlem@hoodlem.me 2 points 1 year ago

It is widely reported that Lemmy has been the target of a massive bot sign-up wave

Sorry I’m out of the loop. Where has this been reported?

[-] senicar@social.cyb3r.dog 3 points 1 year ago

There's been a few posts on it, including one where the OP intentionally voted the post up with an army of bots to demonstrate the problem.

If you run an instance with closed registration you'll probably receive a bunch of incredibly similar, clearly AI generated, applications from bot accounts. They seem to prefer existing instances over spinning up bot instances, to avoid defederation.

[-] GreatAlbatross@feddit.uk 1 points 1 year ago

I think the power of fedi will be that even if these accounts do something in the future (I suspect they're just future astroturf accounts which will be used once aged), it's not like trying to persuade a behemoth corporation to take action.

It'll be a few thousand obvious accounts on most instances, and any sensible admin will be easily able to prune. The ratio of account to admin is that much smaller, meaning going in with a fine-tooth comb isn't impossible.

And any sites that don't take reasonable actions, will likely get de-federated.

It's a nice two-step solution. A local action, and a backup global block.

load more comments
view more: next ›
this post was submitted on 26 Jun 2023
3 points (63.6% liked)

Asklemmy

42601 readers
1300 users here now

A loosely moderated place to ask open-ended questions

Search asklemmy 🔍

If your post meets the following criteria, it's welcome here!

  1. Open-ended question
  2. Not offensive: at this point, we do not have the bandwidth to moderate overtly political discussions. Assume best intent and be excellent to each other.
  3. Not regarding using or support for Lemmy: context, see the list of support communities and tools for finding communities below
  4. Not ad nauseam inducing: please make sure it is a question that would be new to most members
  5. An actual topic of discussion

Looking for support?

Looking for a community?

~Icon~ ~by~ ~@Double_A@discuss.tchncs.de~

founded 5 years ago
MODERATORS