| Welcome to WebmasterWorld Guest from 184.108.40.206 |
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
|Become a Pro Member|
|Robots.txt disallow help|
| 11:32 pm on Nov 23, 2009 (gmt 0)|
How do I disallow dynamic URLs such as:
I want to disallow only the part after "?", therefore I would like to index myforum-topic1.
I cant Disallow: /myforum-topic1?* because I have hundreds of topics, and that would mean to do it manually for all.
disallow /?* and disallow /*?* but when I run my site map generators all URLS with "?" get indexed again.
All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved