How to block this type of URL's

[iCyborg]

well I want to block the url's

http://example.com/blog/page/6/?theme=xyz
http://example.com/blog/this-is-post/?theme=xyz

but want to keep these url's
http://example.com/blog/page/6/
http://example.com/blog/this-is-post/

so basically I just want to block all pages which are ending with "?theme=xyz" as this is causing unnecessary content duplication.

[iCyborg]

I want to prevent them from being indexed

[netchicken1]

Disallow: theme

(I think)

[iCyborg]

Shouldn't there be some * too ?

[firefoxin]

How to block this type of url in robot.txt

http://example.com/member.php?action=email&id=10039‎

[or]

http://example.com/comments.php?shownews=605&highlight=‎

[or]

http://example.com/member.php?action=list‎

[g1smd]

First Question:

Disallow: /[b]*[/b]theme

.

Second Question:

Which URLs are similar to those, but do not need to be blocked?

Otherwise is this what you want?

Disallow: /member
Disallow: /comments

.

Be aware that Google will still list "blocked" URLs as URL-only entries in the SERPs.

[firefoxin]

thanks g1smd

/comments.php?id=3740&ocid=30562&replyid=0&catid=1 [remove]
/comments.php?id=3740&replyid=30574&catid=1 [remove]
/comments.php?shownews=3740 [OK]

i want to remove first two line and 3th one is my primary link.

i think i must use this code :

User-agent: googlebot
Disallow: /*id
Disallow: /*replyid

is that true ?

[g1smd]

Your last suggestion is probably too wide. It will block anything with "id" or "replyid" anywhere in the URL or in the parameters. That's likely going to block some stuff that you don't want blocked. That is, "id" would block anything with "catid" and "ocid" and "docid" as well.

Do you know if the parameters ever appear in a different order?

Do you know if URLs with shownews ever have additional parameters and that you will not want to block those?

Otherwise, I would do:

User-agent: *
Disallow: /comments.php?id=
Disallow: /comments.php?action=
Disallow: /comments.php?highlight=
Disallow: /comments.php?ocid=
Disallow: /comments.php?replyid=
Disallow: /comments.php?catid=

Maybe others too?

You need to be aware of every possible format that could be requested.

You also need to be aware that with parameters in a different order you have a duplicate URL for the same content.

[Jonesy]

Yes, the last suggestion is too wide (by far) and doubly redundant. :)
Referring to:

Disallow: /*id
Disallow: /*replyid

the case of "/*id" will disallow
/avoidupois, /ridiculous, /rancid, /recidivism,
/riddle, /typhoid, /zircofluoride, etc., usw.,
and
anything that looks like: "/*replyid".