Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- Yahoo! Slurp/3.0 released on new IPs


Receptional_Andy - 10:57 pm on Apr 15, 2008 (gmt 0)


From what I've seen, Slurp is still crawling with the new and old UAs. They do seem to be using different approaches, but I haven't figured out what the intention is yet. It's funny watching them both grab pages at the same time, though ;)

Still, these are our sites they're unleashing themselves on. Would be nice to be told what to expect, eh?


Thread source:: http://www.webmasterworld.com/search_engine_spiders/3626881.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com