homepage Welcome to WebmasterWorld Guest from 54.227.141.230
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Accredited PayPal World Seller

Visit PubCon.com
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

    
Excluding Sub Folders
When you exclude a folder, are folders inside that excluded also?
damlag




msg:1525664
 6:32 pm on Sep 25, 2004 (gmt 0)

Hi guys,
Simple question.
I've been looking in this forum and everywhere else, but couldn't get direct answer.

When you want to exclude all spiders from indexing one folder like below:

User-agent: *
Disallow: /Images/

...Does it mean that a folder inside "Images" will be excluded also?

Or I have to type:

User-agent: *
Disallow: /Images/Folder/

Or I have to type:

User-agent: *
Disallow: /Images/
Disallow: /Folder/

Thx.

 

fourstardragon




msg:1525665
 7:03 pm on Sep 25, 2004 (gmt 0)

Hello damlag.
>User-agent: *
>Disallow: /Images/
>
>Does it mean that a folder inside "Images" will be excluded also?
It sure does.

damlag




msg:1525666
 8:39 pm on Sep 25, 2004 (gmt 0)

Thanx fourstardragon.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About
© Webmaster World 1996-2014 all rights reserved