Visitors can view robots.txt file

[palmpal]

Hello,

I just realized that visitors can view my robots.txt file just by typing it in the URL address window. Is there any way to prevent this? My images directory is gives an "unauthorized access" message so I wonder if the robots text file can be protected the same way.

Thanks!

[Timotheos]

Well I think that's the point. Why wouldn't you want anybody to view your robots.txt file? If you block access to this file then how can robots read it?

[palmpal]

Hi,

I include customer proof pages in the robots text file because I don't want my customer names to be picked up. I guess I'm more concerned with non-robots viewing this file and then proceeding to view my customer proof pages.

[Sanenet]

Hi,

You need to password protect the customer proof directories. Using robots.txt is not going to stop people viewing that information!

[palmpal]

Hi,

Can you tell me where to find information about how to do this? Is this accomplished through my web host? I do know my site is hosted on an apache server.

Thanks!

[bcolflesh]

If your host has a control panel utility, that's probably your quickest and easiest route - other than calling them and requesting that they do it.

Do it yourself info here:

[httpd.apache.org...]

[palmpal]

Thanks for the link! I just had a chance to review it. What method is most used?