Welcome to WebmasterWorld Guest from 126.96.36.199
Forum Moderators: goodroi
I've been handed a site to fix which has some duplicate content issues. I need to block everything which starts with:-
The "?" is important as I don't want to block:-
I just want to block anything that looks like:-
The key question is can I use the "?" as a wildcard to block all dynamic content in this way?
I suppose a secondary question would be is there an adhered standard by the SE's in this respect? Or should I expect some weirdness from a. n. other engine (which I won't care about too much as long as it works in you-know-which-one).
I note that Google allows the use of an asterisk as a wildcard, although at first glance there appears to be a typo on their page about this which makes me a little nervous:-
To block access to all URLs that include a question mark (?), you could use the following entry:
From : [google.com...]
Have I mis-interpreted that, or is that a google typo and "allow" should be "disallow"?