homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Google / Google News Archive
Forum Library, Charter, Moderator: open

Google News Archive Forum

virtual domain spidering
is this a potential domain duplication problem?

10+ Year Member

Msg#: 15995 posted 12:12 am on Aug 11, 2003 (gmt 0)

Hi I have one domain as my main ip and a few other sites that are virtual hosted on the same ip.

main domain: www.domain.com

the other domain is


but this can also be reached if you go to:


i know if you never link to www.domain.com/abc ,google wont know about it and only know www.abc.com.

but my problem is some else has link to www.domain.com/abc

Will google see the two url as duplicated content?

hope i was clear enough in my explanation.



WebmasterWorld Senior Member ciml us a WebmasterWorld Top Contributor of All Time 10+ Year Member

Msg#: 15995 posted 11:39 am on Aug 11, 2003 (gmt 0)

You could use a /robots.txt file to prevent spidering of www.domain.com/abc but the 'normal' solution would be to use an HTTP status 301 redirect.

Either of these approaches would save bandwidth. There's been much talk of a mysterious 'duplicate content penalty' but I don't believe in it; when Google find identical pages it merges them, giving both sets of backlinks to whichever address remains.


10+ Year Member

Msg#: 15995 posted 12:15 pm on Aug 11, 2003 (gmt 0)

I would go for the 301 redirect option. Not only will it prevent www.domain.com/abc from appearing, it will also pass on the PR from any links to www.domain.com/abc

Global Options:
 top home search open messages active posts  

Home / Forums Index / Google / Google News Archive
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved