logoalt Hacker News

Tharreyesterday at 4:52 PM3 repliesview on HN

Why would you voluntarily pretend to be a AI bot, when those have already a much higher chance of being blocked? Seems holly unproductive.

Best hypothesis I can come up with is to somehow make the AI companies look bad, but they seem to be doing an excellent job at that themselves already by scraping everyone hundreds of times per hour over and over.


Replies

esskayyesterday at 5:31 PM

Because businesses dont want them blocked, that would be a very stupid thing for most of them to do given its becoming a vital traffic source now that people are using chatbots instead of google.

show 1 reply
red-iron-pineyesterday at 7:20 PM

Googlebot and other web scrapers are how you get visible, how you get adwords, ways to boost your traffic, etc.

bots hitting your site aren't problems per se

xgulfieyesterday at 5:16 PM

Most websites don't have an incentive to block AI bots to their main sites. Think businesses, government and community websites, nonprofits, etc.