logoalt Hacker News

TekMoltoday at 6:36 AM1 replyview on HN

So is it possible to say "No bots except Google, OpenAI, Grok, Claude and Perplexity"?

As far as I can tell, Google is the only one sending me visitors. And the other big AI players might do so in the future.

Another option would be "No anonymous bots". So at least if a bot would want to crawl my site, they would have to identify themselves. Since the rise of the AI bots, I am getting hurt badly with insane amounts of requests from residential IPs that mimic real humans. The only difference being they don't make me any money. Only produce costs.

By the way, how is the situation over at Amazon's Cloudfront? Do they offer something that helps? Anyone here with them?


Replies

nicboutoday at 8:07 AM

Google is actively working on not sending you visitors anymore.