logoalt Hacker News

messe • yesterday at 6:36 AM • 1 reply • view on HN

> It's not about bypassing access restrictions.

Yes. It is. You've just made an arbitrary choice not to define it as such.

Replies

andrew_zhong • yesterday at 7:31 AM

I will add a PR to enforce robots.txt before the actual scraping.