UA: Amazon.com/16.5.0.100 (Android/7.0/LG-H918) Protocol: HTTP/1.1 Robots.txt: No Host: Various
This is the UA used if someone follows a link to your web property from inside Amazon's accounts. The attribute in parenthesis is their OS.
SumGuy
1:25 am on Mar 18, 2018 (gmt 0)
I block amazon / AWS IP space (in large CIDR blocks, when I discover/encounter them) from accessing my web server (they get 403). Your milage may vary, but I can't see an upside to letting them (or who-ever is renting them) from crawling my corporate site.
keyplyr
1:32 am on Mar 18, 2018 (gmt 0)
@SumGuy - this thread is not about Amazon IP ranges. It is about the User Agent (UA) which (as stated above) will come from various IP ranges.
Many site owners do block Amazon ranges - however- you should consider doing the research and not just blocking all Amazon ranges.
Yes a lot of malicious and/or non-helpful UAs make their home at Amazon, however depending on your site's interests, dozens (maybe hundreds) of beneficial agents also come from the many Amazon IP ranges, so you need to set up your IP blocks to allow some UAs.
This is the UA used if someone follows a link to your web property from inside Amazon's accounts. The attribute in parenthesis is their OS.
So it's some kind of proxy?
keyplyr
10:52 am on Mar 18, 2018 (gmt 0)
Not a proxy.
Similar to what Twitter does. It frames your browser with a UI along with its own header fields, but is still using you IP.
TravisDGarrett
10:54 am on Mar 18, 2018 (gmt 0)
okay.
dstiles
11:50 am on Mar 18, 2018 (gmt 0)
> It frames your browser
So what happens on an HTTPS site that has an X-Frame-Options DENY header?
keyplyr
8:05 pm on Mar 18, 2018 (gmt 0)
Not that type of framing dstiles. The page is not framed.
SumGuy
11:26 pm on Mar 18, 2018 (gmt 0)
> this thread is not about Amazon IP ranges. > Many site owners do block Amazon ranges
So it's ok to talk about IP blocking (in this forum) then - but not necessarily in this thread?
keyplyr
11:50 pm on Mar 18, 2018 (gmt 0)
@SumGuy - That's correct. To change topic, just start a new thread.
dstiles
10:39 am on Mar 19, 2018 (gmt 0)
keyplyr - Sorry, I assumed framing as performed by, eg, some nasty site ripper.
keyplyr
10:52 am on Mar 19, 2018 (gmt 0)
Maybe a poor choice of terms on my part. I just meant that the Amazon app wraps a UI (user interface) around whatever browser is default on your device when you follow a link to a remote page.
Twitter does the same thing. In the drop-down there's a feature to "open in _____" so you can switch to your default browser, but the only difference AFAIK is just the header fields sent. It looks the same, other than possibly the color scheme on the browser chrome.
dstiles
12:16 pm on Mar 20, 2018 (gmt 0)
Ok, thanks.
Bewenched
3:24 am on Mar 23, 2018 (gmt 0)
I've blocked most of Amazon's ranges after noticing them pulling images directly from my site into Amazon for people to use to sell the same product. They were generally too lazy to even download and reupload to Amazon through their account.
