logoalt Hacker News

thw_9a83c • today at 5:15 AM • 1 reply • view on HN

Yes, but first we need to figure out how to collect that new information. An efficient and ruthless data harvesting in one of the LLM labs secrets.


Replies

alfiedotwtf • today at 12:54 PM

A distributed, open scraper specifically for LLMs would be interesting . Filtering for spam and useless data would be a challenge at scale, but would be cool