logoalt Hacker News

Machayesterday at 2:05 PM0 repliesview on HN

It is cloudflare who made the claim that they are well behaved unlike those other bots and that their behaviour can be controlled by robots.txt

If I need to treat cloudflare bots the same as malicious bots, that undermines their claim.