Page is a not externally linkable
Air - 12:22 am on Mar 7, 2001 (gmt 0)
I guess BT has answered it, but just to add one more yes, it follows links relentlessly.
>Have you been able to determine if the heavy spidering is a result
>of submitting many pages, or is the spider following links?