Welcome to WebmasterWorld Guest from 54.167.46.29

Forum Moderators: goodroi

Message Too Old, No Replies

Robots.txt - files in folders

     
9:02 pm on Jun 4, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:May 5, 2003
posts:72
votes: 0


If I have a file X in folder Y, and I set robots.txt to:

User-agent: *
Disallow: /Y/X.htm

Will this ONLY affect the file, or the rest of the folder (I'd like the rest of the files in Y to be indexed)

9:25 pm on June 4, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member macguru is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Dec 30, 2000
posts:3300
votes: 0


Hi rintrah,

Yes.

Here is more.

[searchengineworld.com...]

And here is a lot more [google.com]. ;)

9:43 pm on June 4, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:May 5, 2003
posts:72
votes: 0


Wow - thanks!
 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members