Welcome to WebmasterWorld Guest from 54.162.10.132

Forum Moderators: goodroi

Message Too Old, No Replies

Robots.txt

Help please mine is missing?

     
7:10 pm on Jun 25, 2003 (gmt 0)

New User

10+ Year Member

joined:June 21, 2003
posts:2
votes: 0


Hi folks, I noticed today that my site states showed that my robot.txt file was missing so I took a look on the webspace and could not see it.

Anybody anideas how I can get one back?
thanks
Peter
UK

8:31 pm on June 25, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:May 1, 2002
posts:52
votes: 0


Peteredmonds, take a look at the robots.txt tutorial on Search Engine World. It is a simple to follow tutorial to create your own robots.txt. Also, try using the site search link above and type in robots.txt and you will find a lot of info.

[searchengineworld.com...]

8:37 pm on June 25, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member jenstar is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Dec 22, 2002
posts:4663
votes: 0


And welcome to WebmasterWorld :)

Most hosts don't provide a robots.txt file, but it is pretty easy to create your own, run it through the validator, and upload it to your site. The link bluetuna gave has everything you need.