Welcome to WebmasterWorld Guest from 54.144.107.83

Forum Moderators: goodroi

Message Too Old, No Replies

How can I stop search engine to go to my subdomain?

     
2:37 am on Dec 24, 2010 (gmt 0)

Full Member

5+ Year Member

joined:June 26, 2008
posts:229
votes: 2


How can I stop search engines to go to a sub domain of my site?
2:48 am on Dec 24, 2010 (gmt 0)

Moderator from GB 

WebmasterWorld Administrator mack is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:June 15, 2001
posts:7557
votes: 3


The sub domain will be viewed by a bot as a different site. It will therefore read the robots.txt file located at subdmain.example.com/robots.txt

If you disallow robots there, the sub domain wont be crawled.

Mack.
5:02 am on Dec 24, 2010 (gmt 0)

Full Member

5+ Year Member

joined:June 26, 2008
posts:229
votes: 2


Thank you, Mack.
4:16 pm on Jan 2, 2011 (gmt 0)

New User

5+ Year Member

joined:Jan 2, 2011
posts:2
votes: 0


You could also twick the robots.txt file to control which sub-domain will be scanned. could be a powerful tool to 'trick' crawlers "last-scan" timers.