alt Hacker NewsCreate bot detection and bot protection, then sell crawlers. Is this the peak of hypocrisy?
Replies
0xbadcafebee • today at 4:25 PM
That's not peak hypocrisy, that's peak capitalism
Create bot detection and bot protection, then sell crawlers. Is this the peak of hypocrisy?
That's not peak hypocrisy, that's peak capitalism
Let's not conflate crawlers with the traffic that bot protection services block. A crawler that respects robots.txt is a good internet citizen and can provide a vital service.