Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- Yahoo! Slurp/3.0 released on new IPs

jmccormac - 11:37 pm on Apr 15, 2008 (gmt 0)


These guys are the new Microsoft. On one of my sites, they are the second biggest spider by volume each month. In March they downloaded approximately 37K pages and were responsible for about 647 referrals. I am strongly considering banning them.

Regards...jmcc

Thread source:: http://www.webmasterworld.com/search_engine_spiders/3626881.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com