| Restrict Specific Domain Names from Being Indexed Using the robots.txt file on Google to restrict certain domains... |
jmh1970

msg:1529662 | 12:23 am on Oct 29, 2003 (gmt 0) | Hi there all :) I have a website at www.olddomain.com that was listed on Google. I have recently been able to purchase a better domain name that has great keywords - www.newdomain.com. I would like Google to spider the site, but only list the www.newdomain.com domain as I do not want to get penalised for spamming multiple addresses. Basically we use www.olddomain.com for print and www.newdomain.com for web promotion. Any ideas? Thanks in advance. - Ben Slater [edited by: heini at 9:43 am (utc) on Oct. 29, 2003] [edit reason] Please don't post real urls or domain names / Thanks! [/edit]
|
jdMorgan

msg:1529663 | 12:45 am on Oct 29, 2003 (gmt 0) | If you're on Apache, you can use mod_rewrite to redirect robots.txt requests to different files based on the requested domain name using {HTTP_HOST}. On other servers, you could use a script to do essentially the same thing. So, one domain appears to have a robots.txt that allows spidering, and the other one disallows spidering. See [webmasterworld.com...] Jim
|
jmh1970

msg:1529664 | 1:36 am on Oct 29, 2003 (gmt 0) | Hmmmm, thanks for the advice Jim. I will follow up with my webhost to see if they can help...it's good to go in with a little bit of knowledge so I don't look like a complete lamer ;) - Ben
|
|
|