-- Search Engine Spider and User Agent Identification
GaryK - 11:00 pm on Jun 23, 2009 (gmt 0)
Fair is fair, and so I'd like to point out that there are several fake Googlebots running around these days, yet there isn't much Google-bashing going on here for some reason.
Jim, unless I'm mistaken anyone who falls for a fake Googlebot isn't taking the time to do full round-trip DNS lookup. That's why I asked if it were possible for MJ12Bot to use some kind of common root rDNS. If it were possible there would be no basis for questioning his bot much like there's no basis for questioning Googlebot. I asked and got my answer.