Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

disallow URL with parameters

/?id=asdf vs /

8:42 am on Nov 28, 2005 (gmt 0)

New User

10+ Year Member

joined:July 4, 2005
votes: 0

Would the following robots.txt block access to /?id=asdf but would still allow / to be indexed?

User-agent: *
Disallow: /?id=

5:23 pm on Nov 28, 2005 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Dec 5, 2002
votes: 0

Ratbert, it's unlikely to work.

I'd suggest creating a dedicated filename and exclude it specifically.

10:10 pm on Nov 30, 2005 (gmt 0)

Junior Member

10+ Year Member

joined:Apr 24, 2005
votes: 0


pls, correct me, if this is wrong.

i guess, it's that , what u need

User-Agent: *
Disallow: /*?

11:12 am on Dec 1, 2005 (gmt 0)

Junior Member

10+ Year Member

joined:Nov 21, 2004
votes: 0

This is what Google claims, at least for G. bot - see [google.com...]
11:18 am on Dec 1, 2005 (gmt 0)

Senior Member

joined:Jan 27, 2003
votes: 0

You could add a robots meta tag to the pages you want excluded instead - this would probably be simpler than messing with non-standard robots.txt contents.

If you are only concerned about Google, and want non-standard code, I believe the following might work:

User-agent: Googlebot
Disallow: /*id=

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members