Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- New Googlebot
Pfui - 7:20 am on Mar 4, 2006 (gmt 0)
Here's my, um, 'rogue robot' philosophy... "If it looks like a bot, and acts like a bot, and hits bot traps -- it's banned."
: )
Thread source:: http://www.webmasterworld.com/search_engine_spiders/3172.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com