Welcome to WebmasterWorld Guest from 54.196.238.210

Forum Moderators: Ocean10000 & incrediBILL & phranque

Message Too Old, No Replies

How to use a .htaccess file

to keep spiders out

     

needinfo

4:07 pm on May 7, 2003 (gmt 0)

10+ Year Member



I have heard that I can use a .htaccess file to keep all but ONE search engine spiders out of my domain. I am going to use a robots.txt to allow only the ONE robot i want to visit but somebody told me that they would use a .htaccess file just in case.

Could anybody please give me any pointer on how to create one. I did look through some of the old threads but couldn't see anything.

DaveAtIFG

3:39 am on May 8, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



A few tweaks to the Close to perfect .htaccess ban list [webmasterworld.com] should meet your needs.
 

Featured Threads

Hot Threads This Week

Hot Threads This Month