RB2B-bot v0.1

[Mokita]

Does anyone know anything about this bot?

It just requested only pages linked directly from the home page of one of our sites, but didn't go any further.
It did not request robots.txt.

The Reed Business company website yielded me no clues as to what they are doing.

reedbizfw.bos3.fastsearch.net - - [11/Nov/2005:08:19:08 +1100] "GET / HTTP/1.1" 200 5801 "-" "RB2B-bot v0.1 (Using Fast Enterprise Crawler 6 [e-mail])"

[Mokita]

Update: I spoke too soon. It came back a couple of hours later and grabbed the second and third level pages - still didn't request robots.txt. It spidered one directory I have excluded in robots.txt.

I've banned it via .htaccess till I find out what its purpose is.

[volatilegx]

The Fast Enterprise Crawler was Developed by Fast for private use, meaning they sell it to anybody who wants to buy it.

[Mokita]

Ah, many thanks for the reply. It shall stay banned.