Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- possible botnet
jmccormac - 8:45 pm on Aug 22, 2012 (gmt 0)
The odd thing is that botnets don't usually request robots.txt.
Regards...jmcc
Thread source:: http://www.webmasterworld.com/search_engine_spiders/4474787.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com