| Welcome to WebmasterWorld Guest from 18.104.22.168 |
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
|Subscribe to WebmasterWorld|
|robots.txt Disallow query|
Disallow specific query in Robots.txt
| 10:45 pm on Jan 8, 2009 (gmt 0)|
How would I go about Disallowing a query such as:
the numbers of course will change, I would like all "post_id-*.html"
queries Disallowed in robots.txt.
thnx in advance!
| 4:29 am on Jan 9, 2009 (gmt 0)|
| 12:35 pm on Jan 9, 2009 (gmt 0)|
The rule matches "from the left".
More important is to know of similar URLs that you DO NOT wish to disallow.
In your case:
would work, but would obviously disallow a load of other things that you probably do not want to disallow.
You talk about "post_id-*.html" but is there anything you *do* want to allow in the form "post_id-*.<something else>"?
is all you need.
That will match any URL where the URL begins with /forums/post_id.
| 10:35 pm on Jan 9, 2009 (gmt 0)|
Thank you for taking the time to reply g1smd!
Actually the post_id should work fine, there is a topic_id as well that lists the exact same content, only threaded, instead of individual posts.
again thank you again for your time. In due time, I am sure I will subscribe to this site, It's very helpful.
All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
© Webmaster World 1996-2014 all rights reserved