jdMorgan - 2:36 am on Jan 22, 2003 (gmt 0) Also, the reference cited above is for HTTP/1.1 headers, not the Standard for Robot Exclusion [robotstxt.org]. Jim <edit> added link</edit>
Also, the reference cited above is for HTTP/1.1 headers, not the Standard for Robot Exclusion [robotstxt.org]. Jim <edit> added link</edit>
Jim <edit> added link</edit>