Toggle navigation
Dashboard
Dashboard Tracker
Add / Edit My Forums
System Announcements
Discussion
Active Thread Feed
Top Threads Today
Top Threads This Week
Top Threads Library
Go!
View All
View All
Login
Logout
Home
Forums Index
General SEO Issues
/
Sitemaps, Meta Data, and robots.txt
9:42 pm Jul 21, 2026
This page requires javascript.
Forum Moderators:
goodroi
Message Too Old, No Replies
How can I stop search engine to go to my subdomain?
virtualreality
Msg#:4245764
2:37 am on Dec 24, 2010
(gmt 0)
How can I stop search engines to go to a sub domain of my site?
mack
Msg#:4245768
2:48 am on Dec 24, 2010
(gmt 0)
The sub domain will be viewed by a bot as a different site. It will therefore read the robots.txt file located at subdmain.example.com/robots.txt
If you disallow robots there, the sub domain wont be crawled.
Mack.
virtualreality
Msg#:4245791
5:02 am on Dec 24, 2010
(gmt 0)
Thank you, Mack.
Joshb
Msg#:4248312
4:16 pm on Jan 2, 2011
(gmt 0)
You could also twick the robots.txt file to control which sub-domain will be scanned. could be a powerful tool to 'trick' crawlers "last-scan" timers.
Join The Conversation
Register
For Free! -
Become a
Pro Member
!
See forum categories
-
Enter the Forum
Moderators and Top Contributors
Moderator List
| Top Contributors:
This Week
,
This Month
,
Jun
,
May
,
Archive
,
Top 100 All Time
,
Top Voted Members
Hot Threads This Week
July 2026 Google Search Observations
Annoying Crawler, Bot, or what?
Suspicious visitors
Do you still build external links in 2026?
How to find out why a page is suddenly popular?
Home
Forums Index
General SEO Issues
/
Sitemaps, Meta Data, and robots.txt
9:42 pm Jul 21, 2026