logoalt Hacker News

noxvillezayesterday at 10:31 PM1 replyview on HN

Most well-known/large agentic web tools I've seen are actually super honest about who they are -- even when they write out scripts they're very keen to identify themselves using user-agents. Most of the time those tools are fine - it's the ones that happen to have a random choice of the 5 most common Chrome/Firefox user-agents making sequential scrapes but cycling through IPs on African and South American residential IPs that are the problem!


Replies

TurdF3rgusonyesterday at 10:57 PM

Yes I've seen it. ClaudeBot will gleefully announce itself when it hammers my niche website a million times a day.

show 2 replies