Welcome to WebmasterWorld Guest from 23.20.18.183

Forum Moderators: goodroi

Message Too Old, No Replies

Robots.txt - What program to use to write?

I use Frontpage 2002

     
3:15 pm on Jan 29, 2003 (gmt 0)

Full Member

10+ Year Member

joined:Dec 16, 2002
posts:239
votes: 0


Okay, I've read the robots.txt tutorial. It says the robots.txt file should be created in Unix line ender mode.
I would like to add a robots.txt file to my site, so I need step by step instructions please (frontpage user a plus!).
Thanks,
Web Footed Newbie :)
3:25 pm on Jan 29, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Sept 16, 2001
posts:2059
votes: 0


Check out different robots.txt files.
www.webmasterworld.com/robots.txt
www.google.com/robots.txt
www.cnn.com/robots.txt etc.

I use Notepad for writing my Robots.txt file, remember it's a .txt file not a .html file, and therefore pretty much any texteditor will do fine.

When you have created it you just upload it to yoru root WWW folder (Where you have your index/default file)

3:31 pm on Jan 29, 2003 (gmt 0)

Full Member

10+ Year Member

joined:Dec 16, 2002
posts:239
votes: 0


Lazerubb
Thanks, how do you upload the file?
Web Footed Newbie:)
3:34 pm on Jan 29, 2003 (gmt 0)

Full Member

10+ Year Member

joined:Dec 16, 2002
posts:239
votes: 0


Ah, figured out the upload, thanks.