logoalt Hacker News

jdlshoreyesterday at 10:18 PM1 replyview on HN

The issue is that scrapers are rotating their IP and essentially performing a DDoS attack. Anubis is part of a defense-in-depth solution. If scrapers reuse a cookie, traditional anti-abuse mechanisms will work.


Replies

gruezyesterday at 10:27 PM

>If scrapers reuse a cookie, traditional anti-abuse mechanisms will work.

Scrapers can't change their strategy? It's not hard to think of mitigations: keep on using a session until you're banned, and failing that rotate your IP. Nowadays you don't even need to think. You can probably tell a LLM "write me a scraper that has adaptive anti-anti-bot mechanism".

show 2 replies