Welcome to WebmasterWorld Guest from 54.197.177.123

Forum Moderators: goodroi

Message Too Old, No Replies

Robots.txt

Help please mine is missing?

     
7:10 pm on Jun 25, 2003 (gmt 0)

New User

10+ Year Member

joined:June 21, 2003
posts:2
votes: 0


Hi folks, I noticed today that my site states showed that my robot.txt file was missing so I took a look on the webspace and could not see it.

Anybody anideas how I can get one back?
thanks
Peter
UK

8:31 pm on June 25, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:May 1, 2002
posts:52
votes: 0


Peteredmonds, take a look at the robots.txt tutorial on Search Engine World. It is a simple to follow tutorial to create your own robots.txt. Also, try using the site search link above and type in robots.txt and you will find a lot of info.

[searchengineworld.com...]

8:37 pm on June 25, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member jenstar is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Dec 22, 2002
posts:4663
votes: 0


And welcome to WebmasterWorld :)

Most hosts don't provide a robots.txt file, but it is pretty easy to create your own, run it through the validator, and upload it to your site. The link bluetuna gave has everything you need.

 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members