Blinkx/DFS-Fetch

any info on this item?

[jackson]

These things seem to be coming through fast and thick. Again, little here and google offers 24 hits - mostly other site logs. The IP address offers just as little. All this seems to give me good reason to ban this thing via my htaccess.

Extract from my log:

63.251.54.207 - - [05/Oct/2004:20:04:45 -0500] "GET / HTTP/1.1" 200 4876 "-" "Blinkx/DFS-Fetch"
63.251.54.207 - - [05/Oct/2004:20:05:30 -0500] "GET /images/xx.jpg HTTP/1.1" 302 218 "http://www.mydomain.com" "Blinkx/DFS-Fetch"

[fiestagirl]

This belongs to the company that it resolves to when you do a "whois".
Their site says this about the software:
...can be configured to monitor information on Intranet and Internet sites, news feeds, chat streams and internal repositories and alert users to information that is relevant to their specific interests.
I've had them come with this ua also: Mozilla/6.0 [en] (Win32; I)

[pendanticist]

They came by my place the other day, but I held off to see if someone else had visits.

No robots.txt

Multiple files per second.

No methodology to the crawl, totally random.

Pendanticist.