Anyway to exclude getting indexed by spiders in specific countries?
UK and US version of my site-redesign are practically dupes.
BoomCommerce
9:56 pm on Mar 5, 2007 (gmt 0)
UK and US version of my site-redesign are similar enough to get penalized, is there any way to avoid having the UK spider pick up my US site and vice versa?
If possible I'm assuming it has something to do with Robots.txt