Page is a not externally linkable
- Yahoo
-- Yahoo Search Engine and Directory
---- Yahoo Renames Spider
farside847 - 9:03 pm on Feb 19, 2004 (gmt 0)
The new Y! spider is hitting files in banned by my robots.txt file... Anyone else seeing this?
Thread source:: http://www.webmasterworld.com/yahoo_search/1687.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com