Hi all. I've implemented anubis in front of fedia.io in an attempt to mitigate the absolutely insane amount of crawlers hammering the site. I have also reenabled anonymous access, hoping that anubis will be effective at keeping the bots out and letting legit people in.
For reference, I run 17 different instances*. All are using a common postgres database server, running on a latest gen AMD Epyc server with 48 physical/96 logical cores. When I enabled anonymous access previously, fedia.io would consume 6 times the amount of database resources as all the other 16 instances using the database server combined. It's off the hook absurd.
So far, it's going ok with anubis in place and anonymous access. I'll see how it performs over the next day or so.
😞 I found a performance issue with Anubis when using redis (as I was). I moved it to memory and it seems a lot faster. On the images, I am coming to the conclusion that backblaze is just too slow. It’s timing out on certain uploads. I am working on sorting it out. I have a minio server, but I’m needing to migrate off it due to increasing costs/declining donations else I’d move it there. I might try wasabi.