The useragent voyager-hc/1.0, checks robots.txt, 96 hits, all from the IP of 38.113.234.181 (whois comes up at New York New York). Anyone have any further information?
Mokita
2:06 am on Jan 27, 2008 (gmt 0)
Kosmix health, auto and travel search crawler. Previously used voyager/1.0 as its user agent.
kamikaze Optimizer
6:20 pm on Jan 29, 2008 (gmt 0)
It does not obey robots.txt and hence won free listings in my deny section on my htaccess files.
wilderness
6:42 pm on Jan 29, 2008 (gmt 0)
(whois comes up at New York New York)
whois actually comes up with Performance Systems. Save your websites some grief and at the very "miniumn" deny the Cognet sub range.
keyplyr
6:30 am on Jan 30, 2008 (gmt 0)
I have same IP ranges for them.
Has always obeyed robots.txt for me, no bad behavior. However all indication shows only health related topics and marketing. If they're building a general topic index, they're sure taking their time.