homepage Welcome to WebmasterWorld Guest from 54.161.246.212
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

    
robots.txt syntax question
Block access to specific file
bcolflesh

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 47 posted 8:09 pm on Aug 2, 2003 (gmt 0)

I want to Disallow a specific file in a subdirectory beneath root - different sites I've looked at suggest:

Disallow: myfile.html

Disallow: /myfile.html

Disallow: /subdirectory/myfile.html

Which one is correct to keep obedient spiders away from the file?

 

Romeo

10+ Year Member



 
Msg#: 47 posted 8:19 pm on Aug 2, 2003 (gmt 0)

... you should specify the path under document root including that subdirectory, so your 3rd Disallow: is the correct one.

You may look at
[robotstxt.org...]
for further details.

Regards,
R.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved