Page is a not externally linkable
- Yahoo
-- Yahoo Search Engine and Directory
---- Yahoo Slurp isn't crawling deeply


webhound - 1:55 pm on Sep 21, 2005 (gmt 0)


Does anyone here have a complete list of Yahoo's crawlers? We are making some changes to our robots.txt file and I was wondering if "Slurp" is the only known name for all of Yahoo's spiders.


Thread source:: http://www.webmasterworld.com/yahoo_search/3585.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com