Forum Moderators: goodroi
So;
examplehostdotcom/
shouldn't pop up in google but
examplehostedsitedotcom/
should
but examplehostdotcom/hostedsite/
contains the data for
examplehostedsitedotcom/
so my question is; if I put
User-agent: *
disallow: /
in the robots.txt file, will the other domain be indexed or will the robots check the examplehostdotcom/robots.txt file first?
edit: removed links
This is a common problem for people that are hosting multiple domains with only one account. If the pages are being published in both folders than you can block one folder and be ok.
If the pages are being "mirrored" and any change in one folder is repeated in the other then you may not be ok. Since you may end up blocking everything.
My experience is it is best to speak directly with your hosting company and explain what you want. They will know the best how they set up the server. Don't forget to test it using Google's robots.txt validator to ensure everything is doing what it should be.