Forum Moderators: open

Message Too Old, No Replies

Why am I getting so many visitors from an Amazon IP?

         

superclown2

10:19 am on Sep 20, 2023 (gmt 0)



For some weeks now my site keeps getting hammered by bots from Amazon Data Services and as soon as I block one IP range another springs up. It's really messing up my stats.

Are they by any chance starting a chatbot of their own? And is there any way to stop them? Are these visits from Amazon themselves or from other budding search engines using their data services? The latest IP address to soak up my bandwidth was 47.128.62.156.

Any thoughts would be appreciated!

not2easy

12:37 pm on Sep 20, 2023 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



That particular bot (and other AWS traffic at that location) is coming from 47.128.0.0/14 which can be used to block that traffic via your preferred method. The entire range is:
47.128.0.0 - 47.131.255.255
CIDR: 47.128.0.0/14

AWS hosts 'whatever' and they may provide services to hosted entities. Generally they have no relationship to the traffic at all. Your logs would tell you who/what is hitting your site so you can decide what to block and how. The who and how is contained in these forums, but it covers decades, various methods and only you can determine what you want/need to block. A lot of sites decided to let CDNs block unwanted traffic for them.

It may surprise you to see the level of non-human traffic when you start working with your logs.

not2easy

1:04 pm on Sep 20, 2023 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



For some related reading, here are old lists - they are still active at those IPs:

2009: amazonaws.com plays host to wide variety of bad bots
[webmasterworld.com...]

2013: Amazon AWS Hosts Bad Bots
[webmasterworld.com...]

2017: Amazon IP Ranges
[webmasterworld.com...]

2021: Bad Behavior by AmazonAWS and what to do about it?
[webmasterworld.com...]

2022: Any Downside to Blocking Amazonbot?
[webmasterworld.com...]

superclown2

6:24 pm on Sep 20, 2023 (gmt 0)



Thanks, there is a useful list of IPs to block in there. OVH is being a £$%$ nuisance as well, as is Microsoft - I have to be extra careful not to block Bingbot. I'll tolerate the odd search for exploits but these guys are really affecting my work schedules.

not2easy

6:59 pm on Sep 20, 2023 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



Most of those nuisance server farms have more than one thread here, some can be found in the various pinned threads in the forum index: [webmasterworld.com...] or sometimes a search can help.

One of the more recent discussions lists the MSFT ranges that bing uses: [webmasterworld.com...]