I have two websites that are hosted in the same webspace. Both have their own domain names which point to the correct folder for each.
However yahoo appears to be indexing both sites on the same domain name and I am worried that it will cause a duplicate content issue because the subdomain it spiders from within one domain will be the eact same content as for the actual domain name submitted.
Can I put a robots.txt in each folder and in the root. In the root which has its own domain name, if i disallow spidering of the folders with their own domain names, will the spiders when crawling the domain names still get to the folders the sites are in, or do they automatically go to the root of the webspace and se the robot.txt there.
The domain names poit directly to the folders, so if I put robots.txt in each folder specifying not to go out the folder and one in the root saying not to go in any of the other domain name folders, would this solve teh problem. I am only worried that I might inadvertently disallow spidering of the other domain name folders by including a disallow in the root of the hostings webspace.
Thankyou if you can help at all.
Chandrika
