homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

Stop Subdomain Indexing
My Development Subdomain Being Indexed

5+ Year Member

Msg#: 4020682 posted 9:09 pm on Nov 6, 2009 (gmt 0)


I was doing a little research and noticed the test side of our site dev.site.com is being indexed along with site.com. Of course this is duplicate content now.

What is the safest way to stop the search engines from indexing dev.site.com and remove it from the index?



WebmasterWorld Administrator goodroi us a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

Msg#: 4020682 posted 11:01 pm on Nov 8, 2009 (gmt 0)

Use robots.txt to disallow the duplicate files on the dev subdomain. The search engines will stop indexing the dev subdomain and over time drop the pages it has already indexed.

Global Options:
 top home search open messages active posts  

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved