rescendent - 3:59 pm on May 12, 2005 (gmt 0)

Related but from the other point of view. Yahoo et. al indexed my site before all the domains and alternate urls did redirects. Now the site lists together with itself in the search index as described in the first post. (Different versions of the pages as the site was being updated)

This is annoying both for users and for log file analysis.

However now 301 redirects have been put in place, for example:

domain.com
domain.net
www.domain.net
301 Moved permanently -> www.domain.com

Mixed/uppercase URLs (e.g. WWW.domain.com/Widget2.aspx)
301 Moved permanently -> lower case URL (e.g. www.domain.com/widget2.aspx)

Per rewriting URLs (e.g. www.domain.com/widget.aspx?id=2)
301 Moved permanently -> rewritten URL (e.g. www.domain.com/widget2.aspx)

Should this remove the duplicates via normal spidering?

Cheers