homepage Welcome to WebmasterWorld Guest from 54.227.11.45
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Visit PubCon.com
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

    
Excluding Sub Folders
When you exclude a folder, are folders inside that excluded also?
damlag




msg:1525664
 6:32 pm on Sep 25, 2004 (gmt 0)

Hi guys,
Simple question.
I've been looking in this forum and everywhere else, but couldn't get direct answer.

When you want to exclude all spiders from indexing one folder like below:

User-agent: *
Disallow: /Images/

...Does it mean that a folder inside "Images" will be excluded also?

Or I have to type:

User-agent: *
Disallow: /Images/Folder/

Or I have to type:

User-agent: *
Disallow: /Images/
Disallow: /Folder/

Thx.

 

fourstardragon




msg:1525665
 7:03 pm on Sep 25, 2004 (gmt 0)

Hello damlag.
>User-agent: *
>Disallow: /Images/
>
>Does it mean that a folder inside "Images" will be excluded also?
It sure does.

damlag




msg:1525666
 8:39 pm on Sep 25, 2004 (gmt 0)

Thanx fourstardragon.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved