Page is a not externally linkable
-- Yahoo Search Engine and Directory
---- Yahoo Slurp isn't crawling deeply
webhound - 1:55 pm on Sep 21, 2005 (gmt 0)Thread source:: http://www.webmasterworld.com/yahoo_search/3585.htm
Does anyone here have a complete list of Yahoo's crawlers? We are making some changes to our robots.txt file and I was wondering if "Slurp" is the only known name for all of Yahoo's spiders.
Brought to you by WebmasterWorld: http://www.webmasterworld.com