How do i add a robots.txt.?

New to all this and havent got a clue

[gooders2274]

Ive been reading a little on robots.txt and know what it does but i dont understand how i create on or where i upload it to or if i add tags to my pages or what>? Has anyone got some simple instructions i could use to get started please

[treeline]

Here's the official deal:
[robotstxt.org...]

Simply put, you create a file called robots.txt and put it in your home directory. The point of the file is to PREVENT robots accessing content. If you want them scanning your site completely you don't need a robots.txt.

However, your error log can get cluttered up with "robots.txt -- file not found" as the spiders keep checking for it, so it may be worth adding just to clean up your error logs.

[BillyS]

gooders2274 - Make sure you test your robots.txt to make sure it's doing what you want it to do. There are pleanty of online tools to check the file.

If you're using Google Sitemap, they can also help you test BEFORE you upload the file to your site.