Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- Yahoo! Slurp

dstiles - 8:12 pm on Sep 12, 2011 (gmt 0)


Interesting about the /3.0. I enabled that one recently on the crawl IPs after finding it blocked on UA. I assumed it was simply an upgrade on the bot. I'll keep an eye on it. Thanks.

Thread source:: http://www.webmasterworld.com/search_engine_spiders/4360952.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com