alt Hacker NewsThere's a difference between someone running a scraping tool occasionally and bots constantly and rapidly re-scraping the same site over and over again
Replies
qbane • yesterday at 3:55 PM
This is an important context: the site is more likely to be targeted by scrapers because it is a curated collection of scraped information.
➕ show 2 replies
The author's website is responsible for storing its own data. AI services currently treat the entire web as their storage and cache layer.