Readability

[keyplyr]

UA: Readability/740ec9 - http://readability.com/about/
Protocol: HTTP/1.1
Robots.txt: No
Host: Amazon
54.160.0.0 - 54.175.255.255
54.160.0.0/12

Scrapes your web page, removes any ads, republishes your content on their platform. This is the app also used in Safari.

[tangor]

Does it generate a Fleisch-Kincaid score as well? (joke)

I am seeing some of this myself.

Query: What is the webmaster response? Visceral would be kill the mf because I want to serve my ads, but that is a bit narrow in that Mozilla, IE, even Edge has this function, though not usually as clearly defined.

Discussion on this side thought might be beyond the scope of SpiderID forum. Though I not sure where it might take place.

Serious question.

[keyplyr]

We've discussed ad/image-stripping readers before, in several forums. AFAIK there's not much we as webmasters can do about it. As you know, almost all desktop browsers have this function now. It's like the browsers turned against us.

It appeared this bot was working in unison with a mobile human visitor (in this case a Dalvik Android that requested the same page a millisecond earlier) so it may be caching every HTML document, ready to display if the user chooses that function or this may be what it looks like when the user *is* using the reader... if so, we're in luck since the bot can be blocked :)

However I don't recall seeing this bot before a few days ago and these readers have been out for a while; 2+ years in the case of Safari so I'm guessing this bot is associated with an app for Android.

[tangor]

Agreed. This beast is fairly new in my logs and does seem linked to Android. I have seen it on both ad and non-ad pages. What I have noticed is that these pages are columnar and non-RWD. I might have to get back to converting ALL pages. (my bad, but there's only so much time under the sun!)