Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

How to block all subdirectories?



6:51 pm on Nov 17, 2004 (gmt 0)

10+ Year Member


I want our robots.txt to block all our subdirectories, but leave the pages in the root indexed.. how would I do that?



7:05 pm on Nov 17, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member

Using the robots.txt file you will have to list all of your sub directories

User-agent: *
Disallow: /images/
Disallow: /cgi-bin/

Could be a easier way using .htaccess?


Featured Threads

Hot Threads This Week

Hot Threads This Month