Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- New Googlebot UA


Robino - 2:08 pm on Aug 12, 2004 (gmt 0)



This robot has been eating heavily on one of my sites for the last three days.

60,000+ pages! This is about three times the number of pages it's gobbled in the past.


Thread source:: http://www.webmasterworld.com/search_engine_spiders/2488.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com