alt Hacker NewsYou get to decide per bot. Or per category: https://developers.cloudflare.com/bots/concepts/bot/verified... You can make for that Google or all indexers are always allowed.
You get to decide per bot. Or per category: https://developers.cloudflare.com/bots/concepts/bot/verified... You can make for that Google or all indexers are always allowed.
Yes of course but most people are not doing that they simply turn on bot fight mode or similar which excludes verified bots...