Welcome to WebmasterWorld Guest from 54.145.118.24

Forum Moderators: goodroi

Message Too Old, No Replies

robots.txt syntax question

Block access to specific file

     
8:09 pm on Aug 2, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Feb 21, 2003
posts:2355
votes: 0


I want to Disallow a specific file in a subdirectory beneath root - different sites I've looked at suggest:

Disallow: myfile.html

Disallow: /myfile.html

Disallow: /subdirectory/myfile.html

Which one is correct to keep obedient spiders away from the file?

8:19 pm on Aug 2, 2003 (gmt 0)

Preferred Member

10+ Year Member

joined:Sept 28, 2002
posts:505
votes: 0


... you should specify the path under document root including that subdirectory, so your 3rd Disallow: is the correct one.

You may look at
[robotstxt.org...]
for further details.

Regards,
R.

 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members