Page is a not externally linkable
activeco - 8:55 am on Aug 14, 2008 (gmt 0)
RewriteCond %{HTTP_HOST} ^([^.]+)\.yoursite\.com$ Which should rewrite all requests for robots.txt in any subdomain except www to norobots.txt file. norobots.txt: User-agent: *
Or make additional .htaccess rules:
RewriteCond %{HTTP_HOST} !^www\. [NC]
RewriteRule ^robots.txt$ /norobots.txt [L]
Disallow: /