Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

How to block all subdirectories?

6:51 pm on Nov 17, 2004 (gmt 0)

New User

10+ Year Member

joined:Mar 21, 2003
votes: 0


I want our robots.txt to block all our subdirectories, but leave the pages in the root indexed.. how would I do that?


7:05 pm on Nov 17, 2004 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Feb 7, 2003
votes: 0

Using the robots.txt file you will have to list all of your sub directories

User-agent: *
Disallow: /images/
Disallow: /cgi-bin/

Could be a easier way using .htaccess?