Welcome to WebmasterWorld Guest from 23.22.19.253

Forum Moderators: goodroi

Message Too Old, No Replies

Robots.txt

Help please mine is missing?

   
7:10 pm on Jun 25, 2003 (gmt 0)

10+ Year Member



Hi folks, I noticed today that my site states showed that my robot.txt file was missing so I took a look on the webspace and could not see it.

Anybody anideas how I can get one back?
thanks
Peter
UK

8:31 pm on Jun 25, 2003 (gmt 0)

10+ Year Member



Peteredmonds, take a look at the robots.txt tutorial on Search Engine World. It is a simple to follow tutorial to create your own robots.txt. Also, try using the site search link above and type in robots.txt and you will find a lot of info.

[searchengineworld.com...]

8:37 pm on Jun 25, 2003 (gmt 0)

WebmasterWorld Senior Member jenstar is a WebmasterWorld Top Contributor of All Time 10+ Year Member



And welcome to WebmasterWorld :)

Most hosts don't provide a robots.txt file, but it is pretty easy to create your own, run it through the validator, and upload it to your site. The link bluetuna gave has everything you need.