You don't need to deter bots and crawlers. Cloudflare wants you to think you do.