| Will Yahoo obey Wildcards in Robots?
|
CWebguy
msg:3866073 | 6:49 am on Mar 9, 2009 (gmt 0) |
I know Google will, but does anyone know if yahoo will obey wildcard matching in robots? Current code:
Disallow: *?widgetType=* Will this work? Thanks. [edited by: CWebguy at 7:39 am (utc) on Mar. 9, 2009]
|
phranque
msg:3866185 | 11:49 am on Mar 9, 2009 (gmt 0) |
Yahoo! Search Blog » One Standard Fits All: Robots Exclusion Protocol for Yahoo!, Google and Microsoft [ysearchblog.com]
|
CWebguy
msg:3866628 | 8:38 pm on Mar 9, 2009 (gmt 0) |
Ok, thanks, looks like MSN too. What I needed, thanks. By the way, I updated my code to /*widgetType= seems to be what I need. Thanks. [edited by: CWebguy at 8:38 pm (utc) on Mar. 9, 2009]
|
g1smd
msg:3871248 | 9:25 am on Mar 16, 2009 (gmt 0) |
Yes, you never need a trailing * in robots.txt, because patterns match from the left anyway.
|
|
|
