Forum Moderators: goodroi
How would I go about Disallowing a query such as:
[domain.com...]
the numbers of course will change, I would like all "post_id-*.html"
queries Disallowed in robots.txt.
any suggestions?
thnx in advance!
More important is to know of similar URLs that you DO NOT wish to disallow.
In your case:
Disallow: /foru would work, but would obviously disallow a load of other things that you probably do not want to disallow.
You talk about "post_id-*.html" but is there anything you *do* want to allow in the form "post_id-*.<something else>"?
Perhaps:
Disallow: /forum/post_id is all you need.
That will match any URL where the URL begins with /forums/post_id.
Actually the post_id should work fine, there is a topic_id as well that lists the exact same content, only threaded, instead of individual posts.
again thank you again for your time. In due time, I am sure I will subscribe to this site, It's very helpful.
regards, frogz