| Welcome to WebmasterWorld Guest from 18.104.22.168 |
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
|Pubcon Platinum Sponsor 2014|
|robots.txt Disallow query|
Disallow specific query in Robots.txt
How would I go about Disallowing a query such as:
the numbers of course will change, I would like all "post_id-*.html"
queries Disallowed in robots.txt.
thnx in advance!
The rule matches "from the left".
More important is to know of similar URLs that you DO NOT wish to disallow.
In your case:
would work, but would obviously disallow a load of other things that you probably do not want to disallow.
You talk about "post_id-*.html" but is there anything you *do* want to allow in the form "post_id-*.<something else>"?
is all you need.
That will match any URL where the URL begins with /forums/post_id.
Thank you for taking the time to reply g1smd!
Actually the post_id should work fine, there is a topic_id as well that lists the exact same content, only threaded, instead of individual posts.
again thank you again for your time. In due time, I am sure I will subscribe to this site, It's very helpful.
All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved