I would prevent Google scans subdirs on my web site: could I get this with mod_rewrite or something like that?
Thanks!
phranque
8:21 pm on Aug 1, 2007 (gmt 0)
you probably want to use a robots.txt file for that. check out the robots.txt forum charter [webmasterworld.com] for some useful information and examples.