| Welcome to WebmasterWorld Guest from 18.104.22.168 |
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
|Become a Pro Member|
|Will Yahoo obey Wildcards in Robots?|
| 6:49 am on Mar 9, 2009 (gmt 0)|
I know Google will, but does anyone know if yahoo will obey wildcard matching in robots?
Will this work?
[edited by: CWebguy at 7:39 am (utc) on Mar. 9, 2009]
| 11:49 am on Mar 9, 2009 (gmt 0)|
Yahoo! Search Blog » One Standard Fits All: Robots Exclusion Protocol for Yahoo!, Google and Microsoft [ysearchblog.com]
| 8:38 pm on Mar 9, 2009 (gmt 0)|
Ok, thanks, looks like MSN too. What I needed, thanks.
By the way, I updated my code to
seems to be what I need. Thanks.
[edited by: CWebguy at 8:38 pm (utc) on Mar. 9, 2009]
| 9:25 am on Mar 16, 2009 (gmt 0)|
Yes, you never need a trailing * in robots.txt, because patterns match from the left anyway.
All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved