Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

Robots.txt - What program to use to write?

I use Frontpage 2002


Web Footed Newbie

3:15 pm on Jan 29, 2003 (gmt 0)

10+ Year Member

Okay, I've read the robots.txt tutorial. It says the robots.txt file should be created in Unix line ender mode.
I would like to add a robots.txt file to my site, so I need step by step instructions please (frontpage user a plus!).
Web Footed Newbie :)


3:25 pm on Jan 29, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member

Check out different robots.txt files.
www.cnn.com/robots.txt etc.

I use Notepad for writing my Robots.txt file, remember it's a .txt file not a .html file, and therefore pretty much any texteditor will do fine.

When you have created it you just upload it to yoru root WWW folder (Where you have your index/default file)

Web Footed Newbie

3:31 pm on Jan 29, 2003 (gmt 0)

10+ Year Member

Thanks, how do you upload the file?
Web Footed Newbie:)

Web Footed Newbie

3:34 pm on Jan 29, 2003 (gmt 0)

10+ Year Member

Ah, figured out the upload, thanks.

Featured Threads

Hot Threads This Week

Hot Threads This Month