Page is a not externally linkable
- Google
-- Google News Archive
---- robots.txt and googlebot
Powdork - 9:12 pm on Mar 13, 2003 (gmt 0)
Wouldn't the ip ranges of the bots give all the needed info?
Thread source:: http://www.webmasterworld.com/google_archive/10308.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com