Forum Moderators: DixonJones

Message Too Old, No Replies

New Crawler from FAST or site scrape?

         

lstrand

12:35 pm on Sep 1, 2004 (gmt 0)

10+ Year Member



I have a crawler with a user agent of 'FAST Enterprise Crawler 6 used by Cobra Development (admin@fastsearch.com)' all over my entire site this morning with aggressive crawling.

I'm unable to quickly identify to whom it belongs. [fastsearch.com...] seems to be a legitimate site, seems partners with Altavista (odd since I thought Yahoo bought FAST/AlltheWeb). Different than alltheweb.com.

-----
IP = 66.151.181.4
Fast Search and Transfer PNAP-BSN-FASTS-RM-01 (NET-66-151-181-0-1) 66.151.181.0 - 66.151.181.255

CustName: Fast Search and Transfer
Address: 93 Worcester St.
City: Wellesley
StateProv: MA
PostalCode: 02481
Country: US
RegDate: 2003-12-24
Updated: 2003-12-24
-----

All the hits from the same IP.

Anyone seen this crawler? Know where results are being published? Or, it is a robot scraping my site?

pendanticist

6:41 pm on Sep 1, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



New Crawler from FAST site:webmasterworld.com [google.com] might give you some insight.

As educational portals go, I allow all the good ones including FAST.

Warren

3:46 am on Sep 9, 2004 (gmt 0)

10+ Year Member



seems partners with Altavista

Overture bought all of AltaVista.
Overture only bought the websearch division of Fast.
Overture sold off the Enterprise Search Division of AltaVista to Fast.

Overture got bought by Yahoo!