Welcome to WebmasterWorld Guest from 22.214.171.124 , register , free tools , login , search , subscribe , help , library , announcements , recent posts , open posts Subscribe to WebmasterWorld
Robots.txt Help please mine is missing? peteredmonds msg:1528511 7:10 pm on Jun 25, 2003 (gmt 0) Hi folks, I noticed today that my site states showed that my robot.txt file was missing so I took a look on the webspace and could not see it.
Anybody anideas how I can get one back?
thanks Peter UK
Bluetuna msg:1528512 8:31 pm on Jun 25, 2003 (gmt 0)
Peteredmonds, take a look at the robots.txt tutorial on Search Engine World. It is a simple to follow tutorial to create your own robots.txt. Also, try using the site search link above and type in robots.txt and you will find a lot of info.
...] searchengineworld.com Jenstar msg:1528513 8:37 pm on Jun 25, 2003 (gmt 0)
And welcome to WebmasterWorld :)
Most hosts don't provide a robots.txt file, but it is pretty easy to create your own, run it through the validator, and upload it to your site. The link bluetuna gave has everything you need.