homepage Welcome to WebmasterWorld Guest from 54.161.192.61
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

    
Blocking sub-domain in robots.txt?
shaunm



 
Msg#: 4487195 posted 12:38 pm on Aug 22, 2012 (gmt 0)

Hi,

I have seen some people blocking their sub domains(abc.ex.com) in their robots.txt file which was deployed in the root directory(ex.com). Is that correct?

Or robots.txt cannot be used for sub-domains?


Thanks,

 

g1smd

WebmasterWorld Senior Member g1smd us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 4487195 posted 12:42 pm on Aug 22, 2012 (gmt 0)

The file must appear at
subdomain.example.com/robots.txt as accessed from the web.
shaunm



 
Msg#: 4487195 posted 6:16 pm on Aug 22, 2012 (gmt 0)

Thanks g1smd :)

phranque

WebmasterWorld Administrator phranque us a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



 
Msg#: 4487195 posted 8:40 am on Aug 23, 2012 (gmt 0)

um, shaunm?

How do I block a sub-domain? - Sitemaps, Meta Data, and robots.txt forum:
http://www.webmasterworld.com/robots_txt/4480532.htm [webmasterworld.com]

shaunm



 
Msg#: 4487195 posted 10:24 am on Aug 23, 2012 (gmt 0)

@phranque
Oops, I am really sorry I never meant to duplicate my posts. It just happened. The real question is how did I forget my own question? Too bad for me.

Thanks phranque for pointing out :)


Best,

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved