Well I was primarly targeting those that ignore robots.txt and claude is either being a good boy or cloudflare is enforcing my robots.txt, I need to check that. Thanks for letting me know though.