Welcome to WebmasterWorld Guest from 174.129.135.89

Forum Moderators: mademetop

Message Too Old, No Replies

Indexed twice

same website indexed twice

   
12:30 pm on Oct 28, 2005 (gmt 0)

5+ Year Member



I have one hosting company and several small websites.

Each website has its own domain name and is kept in the webspace i have in a separate folder for each and also each is a subdomain of the domain name registered at my webspace.

So my webspace is under the name say www.main.com and each other website has its own domain name, but also something to do with the control panel and adding on domains, each site is also a subdomain of the main.

So www.widgets.com is also found at widgets.main.com.

Anyway, I noticed in my stats that it is registering that yahoo has spidered both names. The problem is since this has happened yahoo is no longing listing my site, maybe because it thinks it is duplicated.

I am afraid that eventually google and msn will also go to the subdomain and think there is duplication and drop me.

Is there any way that I can stop the spiders from spidering the site twice, or is it that for every domain name I have to have separate web host, space, whatever?

Thankyou if you can help.

7:42 pm on Oct 29, 2005 (gmt 0)

WebmasterWorld Senior Member caveman is a WebmasterWorld Top Contributor of All Time 10+ Year Member



So www.widgets.com is also found at widgets.main.com.

Anyway, I noticed in my stats that it is registering that yahoo has spidered both names. The problem is since this has happened yahoo is no longing listing my site, maybe because it thinks it is duplicated.


Ummm, I'm not sure I get the reason for this, but if the same pages are found at widgets.com and widgets.main.com then it IS duplicated. Those are technically different sites. You need to get rid of one or the other.
5:56 am on Oct 31, 2005 (gmt 0)

WebmasterWorld Administrator robert_charlton is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



...maybe because it thinks it is duplicated.

It is duplicated. When identical content shows up on multiple urls, that's duplication.

I am afraid that eventually google and msn will also go to the subdomain and think there is duplication and drop me.

Is there any way that I can stop the spiders from spidering the site twice, or is it that for every domain name I have to have separate web host, space, whatever?

Even if you drop the subdomains (which is what I would suggest, because subdomains have been used for spam enough that they'd probably get you flagged automatically), the multiple sites on the same host are also likely to get you in trouble, particularly on Google. A lot depends on whether the sites are on the same or different topics, and how they're linked, where their inbounds are from, etc; but I'm guessing that your sites are related and are interlinked and probably don't have inbound links from outside your mini-network.

If the sites are on the same subject, I'd recommend folding all of your content into one site. If they're not, I'd keep them very, very separate.