| Welcome to WebmasterWorld Guest from 18.104.22.168 |
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
|Accredited PayPal World Seller|
| 6:49 pm on Jul 27, 2009 (gmt 0)|
Question for the group:
If I have a url with the following string:
Let's say I want to disallow everything after the query value. Would the following robot.txt disallow be applicable:
Any help is much appreciated
| 12:54 pm on Jul 28, 2009 (gmt 0)|
For your robots.txt to block access to all URLs that include a question mark, you can add this entry:
This is not part of the official robots.txt protocol but it is supported by Google, Yahoo and Bing.
All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
© Webmaster World 1996-2014 all rights reserved