logoalt Hacker News

weird-eye-issue • yesterday at 1:38 PM • 1 reply • view on HN

No it's not just a label because it's a category that gets used in the firewall settings. A lot of sites allow only verified bots and block non-verified ones. So yes as I already mentioned website owners can of course block verified bots but it's much much less common than blocking non-verified ones because most site owners don't want to accidentally deindex their site from Google...


Replies

viraptor • yesterday at 8:23 PM

You get to decide per bot. Or per category: https://developers.cloudflare.com/bots/concepts/bot/verified... You can make for that Google or all indexers are always allowed.

➕ show 1 reply