David
Fast must be OK if I allow them in :)
[fast.no...]
I believe they crawl for All the Web

a 206 is a partial content code.
Although this page reads IE errors it applies to most log codes.
[members.tripod.com...]

Hmm, I wonder if this is a new version of Firstpage - Don't believe I have seen the Firstpage retriever before. IP is also new I believe. It's Fast though, no doubt.

heini
there's some very old threads on this, someplace.
I had them denied till a year or so ago because of my lack of desire for RIPE.
However let them back in.

The new UA appeared a couple of months back. Recall reading mention of that in some threads as well.

I did not search WebmasterWorld for these rather I'm recalling from my dark memory ;)

I am not convinced that there is any relationship between Fast Search, Inc., the owner of the remote host that hit DavidT's site, and Fast Search and Transfer ASA which powers AlltheWeb. If anyone has any documentation that a relationship exists, I would certainly like to see it.

Warm,
I did say in the mails that I was recalling from memory and in regards to All the web, I used the term "I believe"

There are two pages of threads on FAST in the archives.
Just do a site search on "66.77.73."

Warmglow, this is the company running ATW:
Fast Search & Transfer, Inc.
Wellesley Gateway
93 Worcester Street
Wellesley, MA 02481
USA

They own the IP block: 66.77.73.

wilderness and heini,

OK, I got it! Thanks for the pointers.

Fast has every single one of my 800 odd pages in its index so.......I guess the point is, I don't understand why there is a browser UA and what is the FirstPage retriever thing and why don't they provide an address for contact, etc.

Hmm, found this: [webmasterworld.com...]

Still don't get the UA though.

Those are the two crawlers I currently see:

FAST-WebCrawler/3.7/FirstPage (atw-crawler at fast dot no;http://fast.no/support/crawler.asp)

FAST-WebCrawler/3.8 (atw-crawler at fast dot no; [fast.no...]

coming in from 66.77.73.88

>why there is a browser UA and what is the FirstPage retriever thing

Ditto. Did you look at your listings in ATW - anything changed, complete refreshment or anything?

No, nothing changed but it was only yesterday.

So it's turned up in my logs too - might really be the newest incarnation of Firstpage. Why no contact address? Perhaps it's an intermediate solution, who knows for which index it spiders, might in the end be the new combined ATW/AV...?

I wonder if this could be what we're seeing?

http ://searchenginejournal.blogspot.com/2003_06_08_searchenginejournal_archive.html#10555603999700981