logoalt Hacker News

archagonyesterday at 11:23 PM0 repliesview on HN

Google ignores robots.txt and botnets residential addresses to crawl anyway? (LLM startups already do this.)