Welcome to WebmasterWorld Guest from 54.205.119.93

Forum Moderators: goodroi

Message Too Old, No Replies

Robots.txt - What program to use to write?

I use Frontpage 2002

   
3:15 pm on Jan 29, 2003 (gmt 0)

10+ Year Member



Okay, I've read the robots.txt tutorial. It says the robots.txt file should be created in Unix line ender mode.
I would like to add a robots.txt file to my site, so I need step by step instructions please (frontpage user a plus!).
Thanks,
Web Footed Newbie :)
3:25 pm on Jan 29, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Check out different robots.txt files.
www.webmasterworld.com/robots.txt
www.google.com/robots.txt
www.cnn.com/robots.txt etc.

I use Notepad for writing my Robots.txt file, remember it's a .txt file not a .html file, and therefore pretty much any texteditor will do fine.

When you have created it you just upload it to yoru root WWW folder (Where you have your index/default file)

3:31 pm on Jan 29, 2003 (gmt 0)

10+ Year Member



Lazerubb
Thanks, how do you upload the file?
Web Footed Newbie:)
3:34 pm on Jan 29, 2003 (gmt 0)

10+ Year Member



Ah, figured out the upload, thanks.
 

Featured Threads

Hot Threads This Week

Hot Threads This Month