alt Hacker NewsIf a site cannot handle traffic from the real Googlebot that is a serious issue with the site itself since it's actually pretty conservative
Also I should note there are lots of fake Googlebots...
Replies
20k • yesterday at 11:59 AM
It is mostly, but it doesn't take a lot of googling to find sites getting ridiculous amounts of traffic from googlebot on google IPs. Its one of the most common complaints about google's search indexing
➕ show 1 reply
Indeed, I've got a site which gets a lot of bot traffic and google bot is pretty sensible compared to a lot of other mainstream bots.