Page is a not externally linkable
- Google
-- Google News Archive
---- robots.txt and googlebot


Powdork - 5:17 am on Mar 11, 2003 (gmt 0)


if you ping crawler9.googlebot.com it is 64.68.87.79

I know that, what I'm asking is if the visits with that user agent string are from ip's that are normally associated with googlebot or if someone is masking as Gbot? I'm guessing that 'Mediapartners' is part of a rdns lookup but my stat program doesn't have that functionality to check.


Thread source:: http://www.webmasterworld.com/google_archive/10308.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com