Page is a not externally linkable
- Google
-- Google News Archive
---- "Googlebot/Test" Pulling External Javascipt?


mayor - 12:42 pm on Mar 20, 2004 (gmt 0)


Well, this bot keeps coming back and is bloating my log files so I did try to exclude it in robots.txt but it doesn't check robots.txt anymore (it did at first) and just keeps sucking up bandwidth.

Would someone please teach this bot some manners!


Thread source:: http://www.webmasterworld.com/google_archive/22740.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com