anallawalla - 1:01 pm on May 29, 2003 (gmt 0)

I don't think I can quote email from a mailing list here but it seems that the Wayback Machine founder Brewster Kahle did offer the code to the NLA but they did not take it.

Apparently only a few sites (~700) have been spidered in the past year. I noticed their spider (a machine that runs HTTrack) visit my site a few times. It has an entry in the state-run directory, which was being spidered, and HTTrack was probably set to spider one external level.

I have since filled out the spidering request form which is linked from Pandora's main page as "Notification Form". Not for my business site (which is unlikely to be spidered, although they have chosen some iconic Aussie businesses as samples), but some noncommercial resources such as a magazine that I help to edit.

- Ash