Welcome to WebmasterWorld Guest from 34.225.194.144

Forum Moderators: goodroi

Message Too Old, No Replies

robots.txt and subdomain

Can I use this file to block a specific subdomain

     
12:57 pm on May 3, 2005 (gmt 0)

New User

10+ Year Member

joined:June 18, 2003
posts:38
votes: 0


Suppose I have a.domain.com and b.domain.com, I'd like to block only a.domain.com from Google. Is this possible? if yes, what is the right way to do it.
1:07 pm on May 3, 2005 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Aug 8, 2004
posts:1679
votes: 0


Yes it is possible because every subdomain will be checked for its own robots.txt located in its root. Therefore in order to block all URLs from a.domain.com then you just need this robots.txt located in its root:

User-agent: Googlebot
Disallow: /

8:47 am on May 4, 2005 (gmt 0)

New User

10+ Year Member

joined:June 18, 2003
posts:38
votes: 0


Thanks for the answer. So, what if I wish to block SEs from all subdomains. Should I place the robots.txt in all subdomain or just the main domain?
8:57 am on May 4, 2005 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Mar 30, 2004
posts:712
votes: 0


Yes, a robots.txt in every subdomain.
 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members