This is a little bit of a wall of text but I hope it will be a nice sample for such a setup.
Isn’t Anubis useless against AI scrapers and just annoying people by now?
The principle is pretty simple : use a little bit of compute. If you’re a bot and want to visit many sites the cost will add up, if you are a human going to a website the 1 second cost for the initial page is not a big deal.
Also notice the difference with the extremely annoying cloudflare checkbox asking if you are a human that became ubiquitous lately. I’d rather wait a second.
I feel like a simple rate limit set to what your server can handle without issues is a better solution. Or combine it with Anubis at least.
This seems to be exactly the content of the post: rate limit + Anubis.
The main point is more about “How to setup Anubis” rather than “Should we use Anubis” as I documented how I did my setup so I will not forget and at the same time sharing the resource. I am also using fail2ban but I didn’t feel a post about how to set ip up would be as useful as documentation and guides seems already there.
Makes sense! Rate limits are important IMO and most sites don’t seem to have them.
