Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

Robots.txt file

How do I do this...

6:57 pm on May 19, 2001 (gmt 0)

Preferred Member

10+ Year Member

joined:July 22, 2000
votes: 0

I have a subdirectory I only want Google to see.
I have another subdirectory I want to keep all spiders out of.
1.How do I write the robots.txt file?
2.Do I put it in the main directory or in
each subdirectory it applies to?


8:27 pm on May 19, 2001 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Jan 18, 2001
votes: 0

See this link for the answer to all your questions: