You don't need a dozen crawlers, just a dozen good search engines that have access to an existing index.