Page is a not externally linkable
-- Google News Archive
---- robots.txt and googlebot
kryton - 5:54 am on Mar 11, 2003 (gmt 0)Thread source:: http://www.webmasterworld.com/google_archive/10308.htm
Powdork, I have no idea. I must admit I thought it was strange with that useragent? Is it possible someone could mask as a googlebot?
Brought to you by WebmasterWorld: http://www.webmasterworld.com