oof that sucks; i really wish there was more info on why google decides to crawl or not crawl a page