Over the past 24 months, the web server logs across a dozen websites I manage have a high percentage of traffic coming from the Hetzner data center. This traffic is coming in via numerous IP addresses assigned to Hetzner. Since the volume of traffic is dramatically larger than the traffic coming from legitimate ISPs (ATT, Verizon, Charter, Comcast, Shaw, etc), I have the impression that the traffic from Hetzner is due to bots/scrapers hosted at the Hetzner data center cloud servers. I have attached a log file of IP addresses hitting the servers from Hetzner.
Does anyone else have an opinion on incoming web server traffic from Hetzner? Does anyone else block all the traffic from these IP addresses?
116.202.236.0/24
116.203.111.0/24
116.203.147.0/24
135.181.140.0/24
135.181.200.0/24
135.181.212.0/24
135.181.213.0/24
135.181.79.0/24
136.243.148.0/24
136.243.150.0/24
136.243.212.0/24
138.201.192.0/24
138.201.194.0/24
138.201.195.0/24
138.201.197.0/24
138.201.198.0/24
138.201.214.0/24
138.201.255.0/24
138.201.31.0/24
142.132.139.0/24
142.132.143.0/24
142.132.248.0/24
144.76.118.0/24
144.76.120.0/24
144.76.137.0/24
144.76.14.0/24
144.76.176.0/24
144.76.186.0/24
144.76.200.0/24
144.76.57.0/24
144.76.60.0/24
144.76.61.0/24
144.76.68.0/24
144.76.96.0/24
148.251.120.0/24
148.251.195.0/24
148.251.244.0/24
148.251.69.0/24
148.251.8.0/24
148.251.9.0/24
157.90.181.0/24
157.90.209.0/24
159.69.189.0/24
162.55.138.0/24
162.55.168.0/24
162.55.213.0/24
162.55.86.0/24
176.9.9.0/24
195.201.148.0/24
195.201.149.0/24
195.201.174.0/24
213.239.216.0/24
23.88.106.0/24
46.4.122.0/24
49.12.196.0/24
49.12.230.0/24
5.161.100.0/24
5.161.66.0/24
5.161.86.0/24
5.161.87.0/24
5.161.95.0/24
5.9.108.0/24
5.9.115.0/24
65.108.0.0/24
65.108.103.0/24
65.108.110.0/24
65.108.128.0/24
65.108.134.0/24
65.108.2.0/24
65.108.44.0/24
65.108.46.0/24
65.108.52.0/24
65.108.64.0/24
65.108.79.0/24
65.21.203.0/24
65.21.232.0/24
65.21.35.0/24
78.46.174.0/24
78.46.61.0/24
88.198.158.0/24
88.198.48.0/24
88.198.48.0/24
88.198.53.0/24
89.163.242.0/24
94.130.18.0/24
94.130.237.0/24
94.130.52.0/24
94.130.64.0/24
95.216.157.0/24
95.216.172.0/24
95.216.73.0/24
95.216.96.0/24
95.217.228.0/24
2a01:4f8:10b:0000:0000:0000:0000:0000/64
2a01:4f8:120:0000:0000:0000:0000:0000/64
2a01:4f8:121:0000:0000:0000:0000:0000/64
2a01:4f8:13a:0000:0000:0000:0000:0000/64
2a01:4f8:140:0000:0000:0000:0000:0000/64
2a01:4f8:141:0000:0000:0000:0000:0000/64
2a01:4f8:150:0000:0000:0000:0000:0000/64
2a01:4f8:161:0000:0000:0000:0000:0000/64
2a01:4f8:162:0000:0000:0000:0000:0000/64
2a01:4f8:162:0000:0000:0000:0000:0000/64
2a01:4f8:190:0000:0000:0000:0000:0000/64
2a01:4f8:191:0000:0000:0000:0000:0000/64
2a01:4f8:192:0000:0000:0000:0000:0000/64
2a01:4f8:200:0000:0000:0000:0000:0000/64
2a01:4f8:201:0000:0000:0000:0000:0000/64
2a01:4f8:202:0000:0000:0000:0000:0000/64
2a01:4f8:210:0000:0000:0000:0000:0000/64
2a01:4f8:211:0000:0000:0000:0000:0000/64
2a01:4f8:212:0000:0000:0000:0000:0000/64
2a01:4f8:a0:0000:0000:0000:0000:0000/64
2a01:4f9:2a:0000:0000:0000:0000:0000/64
2a01:4f9:3b:0000:0000:0000:0000:0000/64
2a01:4f9:4b:0000:0000:0000:0000:0000/64
2a01:4f9:6a:0000:0000:0000:0000:0000/64
2a01:4f9:6b:0000:0000:0000:0000:0000/64
2a09:8700:1:0000:0000:0000:0000:0000/64
