Welcome to WebmasterWorld Guest from 54.162.141.212

Forum Moderators: goodroi

Message Too Old, No Replies

How to block all subdirectories?

     
6:51 pm on Nov 17, 2004 (gmt 0)

10+ Year Member



Hi,

I want our robots.txt to block all our subdirectories, but leave the pages in the root indexed.. how would I do that?

thanks

7:05 pm on Nov 17, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Using the robots.txt file you will have to list all of your sub directories

User-agent: *
Disallow: /images/
Disallow: /cgi-bin/

Could be a easier way using .htaccess?

 

Featured Threads

Hot Threads This Week

Hot Threads This Month