Page is a not externally linkable
- Yahoo
-- Yahoo Search Engine and Directory
---- Yahoo Renames Spider


bonanza - 12:41 pm on Feb 21, 2004 (gmt 0)


The slurp spider is checking robots.txt several times a day almost hourly, but nothing else, for weeks now. I find myself reading that behavior like tea leaves, and I don't like it. The site well established but absent from the Y! serps.

On the other hand, the Yahoo Seeker spider is spidering deeply.

*shrug*


Thread source:: http://www.webmasterworld.com/yahoo_search/1687.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com