Page is a not externally linkable
mortenf - 9:53 am on Nov 3, 2002 (gmt 0)
The robots.txt validator seems to have a small bug. Trying to validate the file at [rdfig.xmlhack.com...] gives no errors, but the file only contains a single line: Disallow:/search/ According to the specification, a record consists of at least on User-agent line and at least one Disallow line. Shouldn't this file be flagged as in error? Regards,
Hi there,
Morten Frederiksen