Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Robots.txt for mirror sites


ScottM - 10:30 pm on Aug 6, 2002 (gmt 0)


Ok...maybe some more explanation would help...

The 'extra' domains would have lots of dup content from some subpages on my main domain.

For example:

www.mysite.com/widgets/blue.htm is original

www.blue-widget.com is an extra domain.

Should I just mix up the content? There is no particular order...it's just a regional directory.

I'm sorry if I'm being elusive...I'm have reasons.


Thread source:: http://www.webmasterworld.com/robots_txt/144.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com