homepage Welcome to WebmasterWorld Guest from 23.20.61.85
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Code, Content, and Presentation / Apache Web Server
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL & phranque

Apache Web Server Forum

    
How to use a .htaccess file
to keep spiders out
needinfo

10+ Year Member



 
Msg#: 182 posted 4:07 pm on May 7, 2003 (gmt 0)

I have heard that I can use a .htaccess file to keep all but ONE search engine spiders out of my domain. I am going to use a robots.txt to allow only the ONE robot i want to visit but somebody told me that they would use a .htaccess file just in case.

Could anybody please give me any pointer on how to create one. I did look through some of the old threads but couldn't see anything.

 

DaveAtIFG

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 182 posted 3:39 am on May 8, 2003 (gmt 0)

A few tweaks to the Close to perfect .htaccess ban list [webmasterworld.com] should meet your needs.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Code, Content, and Presentation / Apache Web Server
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved