Hi folks, I noticed today that my site states showed that my robot.txt file was missing so I took a look on the webspace and could not see it.
Anybody anideas how I can get one back? thanks Peter UK
8:31 pm on Jun 25, 2003 (gmt 0)
Peteredmonds, take a look at the robots.txt tutorial on Search Engine World. It is a simple to follow tutorial to create your own robots.txt. Also, try using the site search link above and type in robots.txt and you will find a lot of info.