Forum Moderators: Robert Charlton & goodroi
Another possible approach mentioned in that thread - and the one I prefer when setting up a new site - is only to apply the secure certificate to a dedicated subdomain, such as secure.example.com.
If you're on Apache then:
1. Make sure mod_rewrite is enabled.
2. Create a second robots.txt, call it robots_ssl.txt, for example.
3. Dissalow Google or any other robots or all robots in that new robots file.
4. Upload that new robots file to the root of your domain.
5. Add the following to your .htaccess file:
RewriteEngine on
Options +FollowSymlinks
RewriteCond %{SERVER_PORT} ^443$
RewriteRule ^robots.txt$ robots_ssl.txt