smart.apnoti.com Robot/v1.34

[keyplyr]

Robots.txt: yes, but was blocked for other files due to UA not being on whitelist.

Came from: 92.51.157.nnn hosteurope.de 92.51.157.0 - 92.51.157.255

While there is a bot info page, it fails to reveal how the retrieved data is used. Says they're in beta.

http://smart.apnoti.com/index/aboutApnotiWebCrawler

[edited by: incrediBILL at 10:25 am (utc) on June 27, 2009]
[edit reason] Obscured IPs [/edit]

[Pfui]

cluster-ck-01.apnoti.com
smart.apnoti.com Robot/v1.34 (http://smart.apnoti.com/index/aboutApnotiWebCrawler)

robots.txt? Yes BUT... Simultaneous with home page grab. Tsk-tsk.
Fake referer/log-spammer? YES... [smart.apnoti.com...]

A German shopping engine. From its blog [blog.apnoti.com]: "Apnoti uses the Amazon Associates Program to make a profit..." Plans to collect Amazon commissions in US, UK, Germany and France; other retailers over time.

Hitting my non-product/retail site suggests their bot goes wherever, whenever.

[GaryK]

smart.apnoti.com Robot/v1.34 (http://smart.apnoti.com/index/aboutApnotiWebCrawler)
92.51.157.nnn
cluster-ck-01.apnoti.com

robots.txt? yes
obeyed? yes - but all it took were default root pages, same as Pfui both at same exact second.

referrer spam? yes, same as Pfui's.