Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

Robots.txt file

How do I do this...



6:57 pm on May 19, 2001 (gmt 0)

10+ Year Member

I have a subdirectory I only want Google to see.
I have another subdirectory I want to keep all spiders out of.
1.How do I write the robots.txt file?
2.Do I put it in the main directory or in
each subdirectory it applies to?


8:27 pm on May 19, 2001 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member

See this link for the answer to all your questions:



Featured Threads

Hot Threads This Week

Hot Threads This Month