Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Yahoo! Slurp Now Supports Wildcards in robots.txt


tedster - 10:56 pm on Nov 6, 2006 (gmt 0)


Here's another nice piece of news from Yahoo (same link):

Oh, by the way, if you thought we didn't support the 'Allow' tag, as you can see from these examples, we do.

Well done, Yahoo. I love to see the web advancing toward what should be a new standard.


Thread source:: http://www.webmasterworld.com/robots_txt/3144662.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com