Welcome to WebmasterWorld Guest from 188.8.131.52
Forum Moderators: goodroi
The above page says that it's OK that
is last (after User-agent: *)
and seems to suggest that the syntax is OK.
[edited by: jatar_k at 12:16 am (utc) on Nov. 9, 2005]
[edit reason] no urls thanks [/edit]
Oh, and while the original file's syntax wasn't per their example, it was legal, per their syntax!
(PS thanks for URLifying my previous post; I had assumed the posing system would do that for me.)
How many pages do you want it to remove?
That si actual pages e.g. /page.php and not /page.php?a=b and all different URL's.
If it is a small number or you can make a high level disallow rule that will match them without wild cards I would try that.
Spiral: thanks but:
..a)Since Google specifically says ( [google.com...] ) that Disallow: /*? is supported, then it should be supported by their bot and their other tools.
..b)Lots of folks will be tripped up by the same bug.
2)I don't have access to the full apache config