Welcome to WebmasterWorld Guest from 54.167.83.224

Forum Moderators: goodroi

Message Too Old, No Replies

How to block all subdirectories?

     
6:51 pm on Nov 17, 2004 (gmt 0)

New User

10+ Year Member

joined:Mar 21, 2003
posts:22
votes: 0


Hi,

I want our robots.txt to block all our subdirectories, but leave the pages in the root indexed.. how would I do that?

thanks

7:05 pm on Nov 17, 2004 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Feb 7, 2003
posts:1179
votes: 0


Using the robots.txt file you will have to list all of your sub directories

User-agent: *
Disallow: /images/
Disallow: /cgi-bin/

Could be a easier way using .htaccess?