http://<hostname.domainname>/robots.txt is access denied can robots

Can robots read robots.txt if I get access denied for this file

[atul_iiit]

I Want robots to exclude indexing some contents from my site so I am putting robots.txt

I am putting my robots.txt in DocumentRoot of my webserver but we have restricted anyone to go to document root by putting access denied

so when I use

[<hostname>.<domainname>...]
I see access denied page

Forbidden
You don't have permission to access /robots.txt on this server.

Can my robots read this file in this case . What should I do so that yahoo or google robots can read this page .

Regards

[The Contractor]

No, they will get the same thing the user gets. Go to your "control panel" link at the top of this page. After clicking the link go to the Plugins>>Server Headers in the lower left column and enter the full path to your robots.txt like(broke hyperlink on purpose add the extra t) htp://<hostname>.<domainname>/robots.txt and you should see exactly what any robot will be faced with as far as permissions etc.

[atul_iiit]

Hi I can go till plugin I don't see Server Headers at bottom left of the page.

Can you please tell me how to get access to that or if I am not acllowed to see it . I can see others like notepad, cookiedomain ...

Atul

[The Contractor]

I don't think it is reserved for a certain status. Maybe things have changed. I would give you the url, but hey, may not be the thing to do. Anyways, you can search for "server header check" and find quite a few of them out there.