I am having a difficult time with robots. While checking stats I found that MSN was trying to reach subdomain pages through my main domains. That is, I found MSN spidering
[domain.com...] (a path that does not exist)
It should be spidering [subdomain.com...]
(By 'subdomain' I mean shared hosting. 'www.domain.com' and 'www.subdomain.com' come up as live sites, not 'www.subdomain.domain.com').
I have been advised to "put a robot.txt file in the route that excludes the sub directories of the subdomains. Then put a robot.txt inside the subdomain dir that excludes it from going back to the route" but I have no clue as to how to do this.
Any help is greatly appreciated!
