LemmyToday

321 readers

10 users here now

If you experience issues or problems with this instance (lemmy.today), this is the place to discuss them. Or if you just want to ask questions about how something works. Anything related to the instance or lemmy itself.

founded 2 years ago

MODERATORS

mrmanager@lemmy.today

Testing server load with login required on old.lemmy.today (lemmy.today)

submitted 1 day ago* (last edited 1 day ago) by mrmanager@lemmy.today to c/lemmytoday@lemmy.today

16 comments fedilink hide all child comments

Hi guys,

Im doing some saturday testing for old.lemmy.today again.

Currently login is required for old.lemmy.today to read posts there. If you are already logged in, you wont notice any difference.

The reason im experimenting is because bots are hammering it, and I wanted to get some statistics of load if I simply dont allow anonymous scraping. Some bots are passing Anubis and scraping content.

So just log in if you havent and it will work just as before.

Thank you!

you are viewing a single comment's thread
view the rest of the comments

[–] mrmanager@lemmy.today 6 points 1 day ago (1 children)

I could but there are so many requests, like 30-50 per second, and even if I could cache the login page, I would still spend the bandwidth to send it back to each of those bots. So because of that, and because its not even the main lemmy.today site, I figured its OK to just return 403.

Server load has decreased to almost nothing on old.lemmy.today. During the years we have been online, more and more bots are scraping and now its just ridicolous. :)

[–] mschae@discuss.mschae23.de 2 points 1 day ago

That bad? That's insane. I hope this will help then, at least :)