Correct Syntax for Blogs in robots.txt

[vincevincevince]

I am sure I am not alone in wanting to know the correct syntax for writing blogs in the robots.txt file.

Brett's [webmasterworld.com...] appears to use the following conventions:

Blog content starts on a line which has a # as the first character, followed by a space.

Semantic sections of the blog are separated by a blank line with no #

Identification of headings seems to be created using:

# =========================================================================== #

If there are any published standards relating to robots.txt blogs, I would appreciate knowing about them.

This seems to be a very important development, especially for those involved in SEO. BT would not be spending the time to build such a blog there were it not the next big thing for SEO.

[bigtoga]

Maybe I'm totally missing what you're asking but that file (robots.txt) seems to be the old robots file. The only "executable" line in this file is:

User-agent: *
Disallow: /

Everything else seems to be comments. If you read the first paragraph, Brett talks about this:

# Actual robots can always be found here for: [webmasterworld.com...]

[DaveN]

yer .. we cloak the robots.txt file here

DaveN