pageoneresults - 4:05 pm on Aug 30, 2002 (gmt 0)

Hello ghealton, welcome to Webmaster World.

Robots Exclusion Protocol [robotstxt.org]

Pointless robots.txt URLs
http //www w3.org/admin/robots.txt
http //www w3.org/~timbl/robots.txt
ftp //ftp w3.com/robots.txt

So, you need to provide the "/robots.txt" in the top-level of your URL space. How to do this depends on your particular server software and configuration.

For most servers it means creating a file in your top-level server directory. On a UNIX machine this might be...

/usr/local/etc/httpd/htdocs/robots.txt