this post was submitted on 21 Jan 2026
23 points (92.6% liked)

sh.itjust.works Main Community

8352 readers
1 users here now

Home of the sh.itjust.works instance.

Matrix

founded 2 years ago
MODERATORS
 

For me at least, for months now, this instance is unavailable for multiple hours a day. Given the recent posts about the lemmy eco system being on a slight downwards trend, I don't think this additional load is caused by more users using this instance. Rather, I think that AI scrapers are using this instance to scrape lemmy. If I am correct, though only someone with access to the logs can check, I'd like to kindly ask for some sort of protection from AI scrapers. Both because I like being able to actually browse the instance and because I hate AI companies.

top 11 comments
sorted by: hot top controversial new old
[–] TheDude@sh.itjust.works 5 points 6 days ago (1 children)

Hey all,

I am very well aware of the slowness and timeouts that people are experiencing. I'm working on getting a few upgrade put into place to bring things back to where they need to be. Thanks for the patience!

[–] WolfLink@sh.itjust.works 20 points 1 week ago (2 children)

I use an app for my Lemmy browsing and I’d really like that to not break :/

[–] artwork@lemmy.world 2 points 1 week ago* (last edited 1 week ago)

I am not sure how an app crashing is related to a certain Lemmy Community, but just in case there's a marvelous Thunder (source) that is working like a charm ✨

[–] nao@sh.itjust.works 1 points 1 week ago

As an alternative, is it possible to disable the guest mode (reading without being logged in) on a lemmy instance?

On the downside, it would make it less accessible for new users or users who simply don't want to use an account. But maybe it would be worth it, if it would help to stop scrapers.

Or the middle ground, have a captcha only in front of of the guest mode.

[–] partial_accumen@lemmy.world 14 points 1 week ago (1 children)

Some Lemmy instances use Cloudflare for protection. I know that sopuli.xyz uses Anubis instead. Both these approaches would offer scraper protection without a captcha which would certainly be a high friction event for human users. Does shitjustworks use something like this?

[–] artwork@lemmy.world 2 points 1 week ago* (last edited 1 week ago)

Related: Army of AI crawlers (...are extremely slowing us; AI crawlers learned how to solve the Anubis challenges... - Codeberg...)

[–] sbv@sh.itjust.works 9 points 1 week ago

I've noticed the slowness too. It's lousy, because this is the instance I recommend to normies.

But picking a solution without knowing the problem is a bit premature.

[–] smuuthbrane@sh.itjust.works 5 points 1 week ago (1 children)

Will that fix all the timeout issues sh.itjust.works has had?

[–] Quacksalber@sh.itjust.works 3 points 1 week ago

The hope is that yes, it would.

[–] Pandantic@midwest.social 2 points 1 week ago

You all should @ your instance admin.