Forum Moderators: phranque
I'm trying to disallow robots.txt from viewing with .htaccess like that:
<Files .htaccess>
order allow,deny
deny from all
</Files>
<Files robots.txt>
order allow,deny
deny from all
</Files>
Now, my question is : could the robots read the robots.txt and if not does it mean that they will index the whole site?
Thanks.