block cgi bin on a virtual host

cgi bin is not in root directory

[Reid]

Ok I am on a virtual host and my root directory is called httpdocs.

cgi-bin is in the same directory as httpdocs. (I have limited access to this, only full access to httpdocs, errordocs, cgi-bin through a form interface ect) so by all accounts httpdocs is my root directory and robots.txt works fine there.

robots.txt is in httpdocs.

I want to stop google (or anyone else) from indexing my tracking url's

w*w.mydomain.com/cgi-bin/click.cgi?id=x

if I use
Disallow: /cgi-bin/

would this do the trick? or should go with

Disallow: /cgi-bin/click.cgi?*

currently there is nothing else in my cgi-bin but i may use it in the future although I probably won't want anything in there crawled anyway.

[mack]

You could leave both as a safety net, although the first version...
Disallow: /cgi-bin/
Would work fine to stop it crawling anythign in the cgi-bin.

Some url's may still show up in results pages though. Google has a bad habit of showing pages it knows exist, but hasn't been alllowed to crawl. In this case it will use and anchor text from a link as the title in the results page, and show no description.

Mack.

[Reid]

thanx mack

you know I should have blocked it right away but

better late than never I guess.