alt Hacker News> allowing Googlebot to crawl my sites
As far as I know, you don't have a choice. They have no obligation to respect your wishes, and LLMs are legally allowed to scrape & republish your content.
Replies
oh_no • yesterday at 8:15 PM
except google does respect robots.txt so you do have a choice?
➕ show 1 reply
> They have no obligation to respect your wishes
I have no obligation to not send all scraper-looking traffic to a black hole full of zip bombs.