Restrict Specific Domain Names from Being Indexed

Using the robots.txt file on Google to restrict certain domains...

[jmh1970]

Hi there all :)

I have a website at www.olddomain.com that was listed on Google. I have recently been able to purchase a better domain name that has great keywords - www.newdomain.com.

I would like Google to spider the site, but only list the www.newdomain.com domain as I do not want to get penalised for spamming multiple addresses. Basically we use www.olddomain.com for print and www.newdomain.com for web promotion.

Any ideas?

Thanks in advance.

- Ben Slater

[edited by: heini at 9:43 am (utc) on Oct. 29, 2003]
[edit reason] Please don't post real urls or domain names / Thanks! [/edit]

[jdMorgan]

If you're on Apache, you can use mod_rewrite to redirect robots.txt requests to different files based on the requested domain name using {HTTP_HOST}. On other servers, you could use a script to do essentially the same thing.

So, one domain appears to have a robots.txt that allows spidering, and the other one disallows spidering.

See [webmasterworld.com...]

Jim

[jmh1970]

Hmmmm, thanks for the advice Jim. I will follow up with my webhost to see if they can help...it's good to go in with a little bit of knowledge so I don't look like a complete lamer ;)

- Ben