Welcome to WebmasterWorld Guest from 220.127.116.11 , register , free tools , login , search , subscribe , help , library , announcements , recent posts , open posts Subscribe to WebmasterWorld
Robots.txt - What program to use to write? I use Frontpage 2002 Web Footed Newbie msg:1527339 3:15 pm on Jan 29, 2003 (gmt 0) Okay, I've read the robots.txt tutorial. It says the robots.txt file should be created in Unix line ender mode. I would like to add a robots.txt file to my site, so I need step by step instructions please (frontpage user a plus!). Thanks, Web Footed Newbie :)
lazerzubb msg:1527340 3:25 pm on Jan 29, 2003 (gmt 0)
Check out different robots.txt files. www.webmasterworld.com/robots.txt www.google.com/robots.txt www.cnn.com/robots.txt etc.
I use Notepad for writing my Robots.txt file, remember it's a .txt file not a .html file, and therefore pretty much any texteditor will do fine.
When you have created it you just upload it to yoru root WWW folder (Where you have your index/default file)
Web Footed Newbie msg:1527341 3:31 pm on Jan 29, 2003 (gmt 0)
Lazerubb Thanks, how do you upload the file? Web Footed Newbie:) Web Footed Newbie msg:1527342 3:34 pm on Jan 29, 2003 (gmt 0)
Ah, figured out the upload, thanks.