| Welcome to WebmasterWorld Guest from 126.96.36.199 |
register, login, search, subscribe, help, library, PubCon, announcements, recent posts, open posts,
|Subscribe and Support WebmasterWorld|
| 6:49 pm on Jul 27, 2009 (gmt 0)|
Question for the group:
If I have a url with the following string:
Let's say I want to disallow everything after the query value. Would the following robot.txt disallow be applicable:
Any help is much appreciated
| 12:54 pm on Jul 28, 2009 (gmt 0)|
For your robots.txt to block access to all URLs that include a question mark, you can add this entry:
This is not part of the official robots.txt protocol but it is supported by Google, Yahoo and Bing.
All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
WebmasterWorld ® and PubCon ® are a Registered Trademarks of Pubcon Inc.
© Pubcon Inc. 1996-2012 all rights reserved