Using multiple hash marks

Does that conform to protocol?

[Reno]

Is it OK to put multiple notes to myself with a "#" at the top of my robots.txt file?

For example, instead of:

# For domain: [domainname.com...]

User-agent: googlebot
Disallow: /*.cgi$

I might want to have:

# For domain: [domainname.com...]
# removed links page in June 07
# added cgi in July 07

User-agent: googlebot
Disallow: /*.cgi$

Don't want to confound the spiders if that's wrong...

.....................................

[goodroi]

i've not heard of any issues with multiple comments

[Reno]

Thanks goodroi -- I assumed that was the case but wanted to confirm...

..................

[jdMorgan]

If you want to be assured that *all* spiders process your file correctly, do not use blank lines except at the end of per-spider records. That is, use blank lines *only* to separate records, and include a blank line at the end:

# robots.txt for http://www.example.com
#
# Googlebots
# removed links page in June 07
# added cgi in July 07
User-agent: Googlebot
Disallow: /*.cgi$

# Live MSNbot, Yahoo! Slurp, and Ask Teoma
# Added crawl-delay Oct, 2006
User-agent: msnbot
User-agent: Slurp
User-agent: Teoma
Crawl-delay: 10
Disallow: /*.cgi$
Disallow: /forums

# Disallow all others
User-agent: *
Disallow: /

Note *no* blank line at the top, single blank lines between the records, and a blank line at the end.

Jim

[Reno]

Thanks Jim -- that is exactly the kind of details I was wondering about...

.................