Page is a not externally linkable
tedster - 1:40 am on Oct 30, 2003 (gmt 0)
What you need if you want to allow all spiders to roam your site without restriction is:
The robots.txt protocol only allows for "disallow:" statements (not allow: statements) and wildcards don't belong in the disallow. user-agent: *
disallow: