Forum Moderators: goodroi

Message Too Old, No Replies

*/? */index.*? is a must in robots.txt

I see /?widgetid=45 indexed

         

AjiNIMC

8:36 am on Jan 25, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Hi,

I see that xyz.com/?widgetid=45 indexed by Google. I think I should add /? to stop it

There can be other folders, so I have to add */? .. this takes care of /index.html?widgetid=45 but not /index.php?widgetid=45 so

here is the final solution for all such issues


Disallow: */?
Disallow: */index?

Thanks,
AjiNIMC

AjiNIMC

10:38 am on Jan 25, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I think Disallow: *? will have be better I guess. Is there any disadvantage in using this?

tedster

8:17 am on Jan 30, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Google recommends this:

To block access to all URLs that include a question mark (?), you could use the following entry:
User-agent: *
Disallow: /*?

[google.com...]