homepage Welcome to WebmasterWorld Guest from 54.226.235.222
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Visit PubCon.com
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

    
disallow & allow
doumiao




msg:3723150
 6:28 pm on Aug 14, 2008 (gmt 0)

i want to disallow:

[doumiao.net...]
[doumiao.net?bbs...]
[doumiao.net...]
..........

and want to allow:

[doumiao.net...]
....

so i write :

User-agent: *
Disallow: /bbs/read.php?*&*

but the Google Analyze robots.txt displays a syntax not understood error.

so i need help..thanks

 

g1smd




msg:3723227
 7:22 pm on Aug 14, 2008 (gmt 0)

You don't the second * in the rule.

The rule matches from the left anyway.

Wildcards are only needed at the beginning or in the middle, not at the end.

doumiao




msg:3723576
 6:14 am on Aug 15, 2008 (gmt 0)

ha, i see

thanks :)

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved