Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Allow: ?

g1smd - 12:10 am on Oct 1, 2011 (gmt 0)


Some searchengine bots understand "Allow". Most bots do not.

I believe you need a blank line before the sitmap line.

Use example.com in this forum to suppress the auto-linking function. See RFC 2606.

Thread source:: http://www.webmasterworld.com/robots_txt/4369350.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com