homepage Welcome to WebmasterWorld Guest from 54.227.12.219
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

    
Will Yahoo obey Wildcards in Robots?
CWebguy




msg:3866073
 6:49 am on Mar 9, 2009 (gmt 0)

I know Google will, but does anyone know if yahoo will obey wildcard matching in robots?

Current code:
Disallow: *?widgetType=*

Will this work?

Thanks.

[edited by: CWebguy at 7:39 am (utc) on Mar. 9, 2009]

 

phranque




msg:3866185
 11:49 am on Mar 9, 2009 (gmt 0)

Yahoo! Search Blog One Standard Fits All: Robots Exclusion Protocol for Yahoo!, Google and Microsoft [ysearchblog.com]

CWebguy




msg:3866628
 8:38 pm on Mar 9, 2009 (gmt 0)

Ok, thanks, looks like MSN too. What I needed, thanks.

By the way, I updated my code to

/*widgetType=

seems to be what I need. Thanks.

[edited by: CWebguy at 8:38 pm (utc) on Mar. 9, 2009]

g1smd




msg:3871248
 9:25 am on Mar 16, 2009 (gmt 0)

Yes, you never need a trailing * in robots.txt, because patterns match from the left anyway.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved