Forum Moderators: goodroi

Message Too Old, No Replies

Wildcards special syntax for Google

publish Google unswer about special Google syntax in robots.txt plus examle

         

spiral

9:40 am on Jan 25, 2006 (gmt 0)

10+ Year Member



Hi, guys
You may find it interesting - I used special syntax in robots.txt that G. claims to works and got an error. After a while, they answered - see below:

Q.:
I created new robots.txt file according to the suggetions on [google.com...]
While uploading my new robots.txt file on [services.google.com:8882...] I've got this
error:

URLs cannot have wild cards in them (e.g. "*"). The following line contains a wild card:
DISALLOW /*.gif$
Does it mean that I have to have regular robots.txt file to use removal tool?

A:
As you may know, disallow lines that include wildcards are not considered valid for the robots.txt standard, and they cannot be submitted to our removal tool. If you would like to submit your robots.txt file to our automatic URL removal system for immediate review, you should include each URL that would like to exclude from appearing in our search results.

Hope it helps.

Dijkgraaf

3:44 am on Jan 26, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I think they just copied and posted the instructions for robots.txt for Googlebot, and forgot to change it for their removal tool.
We have had earlier threads [webmasterworld.com] on the subject of the removal tool not supporting wild cards
.
Thanks for letting us know Googles response on the matter.