Welcome to WebmasterWorld Guest from 54.161.110.186

Forum Moderators: goodroi

Message Too Old, No Replies

robots.txt Disallow query

Disallow specific query in Robots.txt

     
10:45 pm on Jan 8, 2009 (gmt 0)

5+ Year Member



Hello!

How would I go about Disallowing a query such as:

[domain.com...]

the numbers of course will change, I would like all "post_id-*.html"
queries Disallowed in robots.txt.

any suggestions?

thnx in advance!

4:29 am on Jan 9, 2009 (gmt 0)

5+ Year Member



bump
12:35 pm on Jan 9, 2009 (gmt 0)

WebmasterWorld Senior Member g1smd is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



The rule matches "from the left".

More important is to know of similar URLs that you DO NOT wish to disallow.

In your case:

Disallow: /foru

would work, but would obviously disallow a load of other things that you probably do not want to disallow.

You talk about "post_id-*.html" but is there anything you *do* want to allow in the form "post_id-*.<something else>"?

Perhaps:

Disallow: /forum/post_id

is all you need.

That will match any URL where the URL begins with /forums/post_id.

10:35 pm on Jan 9, 2009 (gmt 0)

5+ Year Member



Thank you for taking the time to reply g1smd!

Actually the post_id should work fine, there is a topic_id as well that lists the exact same content, only threaded, instead of individual posts.

again thank you again for your time. In due time, I am sure I will subscribe to this site, It's very helpful.

regards, frogz

 

Featured Threads

Hot Threads This Week

Hot Threads This Month