its the same way they crawl websites, its horribly inefficient