Welcome to WebmasterWorld Guest from 54.166.203.76

Forum Moderators: goodroi

Message Too Old, No Replies

How can I stop search engine to go to my subdomain?

     
2:37 am on Dec 24, 2010 (gmt 0)

Full Member

5+ Year Member

joined:June 26, 2008
posts:264
votes: 5


How can I stop search engines to go to a sub domain of my site?
2:48 am on Dec 24, 2010 (gmt 0)

Moderator from GB 

WebmasterWorld Administrator mack is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:June 15, 2001
posts:7691
votes: 37


The sub domain will be viewed by a bot as a different site. It will therefore read the robots.txt file located at subdmain.example.com/robots.txt

If you disallow robots there, the sub domain wont be crawled.

Mack.
5:02 am on Dec 24, 2010 (gmt 0)

Full Member

5+ Year Member

joined:June 26, 2008
posts:264
votes: 5


Thank you, Mack.
4:16 pm on Jan 2, 2011 (gmt 0)

New User

5+ Year Member

joined:Jan 2, 2011
posts:2
votes: 0


You could also twick the robots.txt file to control which sub-domain will be scanned. could be a powerful tool to 'trick' crawlers "last-scan" timers.
 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members