Forum Moderators: phranque

Message Too Old, No Replies

Simple question

Could I prevent undesired scannings?

         

specter

6:18 pm on Aug 1, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I would prevent Google scans subdirs on my web site: could I get this with mod_rewrite or something like that?

Thanks!

phranque

8:21 pm on Aug 1, 2007 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



you probably want to use a robots.txt file for that.
check out the robots.txt forum charter [webmasterworld.com] for some useful information and examples.

specter

9:44 pm on Aug 1, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Thanks for link and reply!