alt Hacker Newsinstead of scraping then, they could pay the fsf for a dump of the site or some API access or something, right? why overload the servers normally.
instead of scraping then, they could pay the fsf for a dump of the site or some API access or something, right? why overload the servers normally.
That's what commoncrawl does.