Welcome to WebmasterWorld Guest from 54.234.52.37

Forum Moderators: goodroi

Message Too Old, No Replies

Robots.txt - Disallow subdomain only

     

pavlovapete

11:50 pm on Aug 16, 2010 (gmt 0)

10+ Year Member



I am new to using robots.txt on subdomains.

We have recently added a new subdomain forums.mysite.com and I'd like to exclude bits until we are ready to launch.

If I use:
User-agent: *
Disallow: /

Will that exclude the robots from the whole domain?

I am planning to put the robots.txt in the subdomain folder - should I be putting it in the main root domain instead?

Thanks for any advice

phranque

8:50 am on Aug 17, 2010 (gmt 0)

WebmasterWorld Administrator phranque is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



the robots.txt file must exist in the root directory of the relevant hostname.
for example you could have a /path/to/http/docs/robots.txt file for http://example.com/robots.txt and another /path/to/http/docs/subdomain/robots.txt file for http://subdomain.example.com/robots.txt

pavlovapete

7:30 am on Aug 26, 2010 (gmt 0)

10+ Year Member



Sorry for the late reply phranque - I missed your reply.

And thanks for the info - I'll be implementing what you suggested.

Cheers