Welcome to WebmasterWorld Guest from 23.20.6.115

Forum Moderators: goodroi

Message Too Old, No Replies

robots.txt Disallow query

Disallow specific query in Robots.txt

     
10:45 pm on Jan 8, 2009 (gmt 0)

Junior Member

5+ Year Member

joined:Dec 26, 2008
posts:75
votes: 0


Hello!

How would I go about Disallowing a query such as:

[domain.com...]

the numbers of course will change, I would like all "post_id-*.html"
queries Disallowed in robots.txt.

any suggestions?

thnx in advance!

4:29 am on Jan 9, 2009 (gmt 0)

Junior Member

5+ Year Member

joined:Dec 26, 2008
posts:75
votes: 0


bump
12:35 pm on Jan 9, 2009 (gmt 0)

Senior Member

WebmasterWorld Senior Member g1smd is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:July 3, 2002
posts:18903
votes: 0


The rule matches "from the left".

More important is to know of similar URLs that you DO NOT wish to disallow.

In your case:

Disallow: /foru

would work, but would obviously disallow a load of other things that you probably do not want to disallow.

You talk about "post_id-*.html" but is there anything you *do* want to allow in the form "post_id-*.<something else>"?

Perhaps:

Disallow: /forum/post_id

is all you need.

That will match any URL where the URL begins with /forums/post_id.

10:35 pm on Jan 9, 2009 (gmt 0)

Junior Member

5+ Year Member

joined:Dec 26, 2008
posts:75
votes: 0


Thank you for taking the time to reply g1smd!

Actually the post_id should work fine, there is a topic_id as well that lists the exact same content, only threaded, instead of individual posts.

again thank you again for your time. In due time, I am sure I will subscribe to this site, It's very helpful.

regards, frogz