Interesting. I wonder if it can become enforceable to say "not on my lawn". Sites could make deals with say Anthropic to make Claude respect some new rule in robots.txt and refuse to visit this site.
Should everyone and their grandma be allowed to send a robot to interact with any site?