For several days now Dustloop has been chugging quite a bit, making access to the site rather inconsistent. If you've been wondering why that is, Tarkus Lee, one of the site's lead devs, offered an explanation. It's rather depressing.

The website has been recieving 30k requests from Claude bot per hour. That's an absurd amount of traffic for a niche community website to handle.

To some extent Cloudflare is meant to help curbstomp the never-ending scraping bots, but even with all the AI protection settings turned on, it seems like Dustloop is still having some issues.

Tarkus Lee added that they might consider using Anubis, a solution against bots that has proven itself to be effective, yet somewhat intrusive compared to Cloudflare.

It doesn't seem like Dustloop itself is in any danger of going under, but it's not good that even something as niche wiki websites operated entirely by the community are at risk.

This material was created with the support of our Patrons. You can support us!

Become a Patron