Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- MSN's many cloaked bots. Again.
AlexK - 3:46 am on Aug 17, 2010 (gmt 0)
dstiles:
| "high speed" bandwidth is helping this along |
|
The record on my site so far is DHL at >300 hits / sec (no kidding).
Thread source:: http://www.webmasterworld.com/search_engine_spiders/4182830.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com