8 different spiders

FAST-WebCrawler/2.2-pre9

[jimbo2000]

for the last week or so FAST has been crawling a client's 1000+ page new site. I have seen many user agents operating from alltheweb.

FAST-WebCrawler/2.2-pre9

there are 8 different versions of the spider beginning with pre2 .. some days I get multiple versions of the spider .. I have counted 8 versions but there may be many more ..

I wonder what the pre means?? is this the spider they use before a new site is added (i.e. PRE-addition) ?? Or is it a prototype for a new general purpose indexing robot for FAST (PRE-release beta)??

It hit me more than 600 times in a 24 hour period one day last week. Also, every day it hits me so does my old friend
Lycos_Spider_(T-REX)

[NFFC]

>is this the spider they use before a new site is added

No, they are hitting domains that have been in the dB since last year.