logoalt Hacker News

singpolyma3yesterday at 2:41 AM0 repliesview on HN

Is there any evidence OpenAI has been ignoring robots.txt for scraping purposes? AFAIK the main sources of that traffic are still unknown.