What are these +1200 USA datacenters bots doing to my site ?

[adrianTNT]

I posted a similar topic in AdSense area but I was told this is a better place to ask.
My site is getting hit very often by a group of bots, I was able to identify 1200 IPs, all from USA, all from datacenters (no residential IPs).

They were all using same resolution and this user agent:

Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.131 Safari/537.36

When I blocked that, they switched to this one (I can clearly see this switch in Google analytics).

Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.130 Safari/537.36

ALL these over 1200 IPs have squid proxy running on eider port 31128, 40000 or 60000

But I don't find much info about these IPs online, makes me think it is a private network of proxy servers, not sold to everyone.

I need help identifying what they are doing to my site, I think they eider click on AdSense ads or they try to somehow manipulate my rankings on google, could be that they click my url in google, then they go back to google, that would be a signal that my site doesn't contain what they searched for, decreasing my rank, I don't care if others say it doesn't work that way :)

It might be a much wider issue that is directed against AdSense ads and maybe I am not targeted on purpose.

This is a correlation between the day when bots start hitting the site and the google traffic (both in 2017 and 2019), I say it looks disturbing, what do you think ?

[imgur.com...]

Edit: The site is an android downloads related site, 80% of users are on mobile devices.

They affect both google traffic and AdSense earnings, the second one might just be an effect of exaggerated number of page views (all from USA).

I will post the full list of IPs in next post, so if this is not a good idea, admins can delete that.

// I avoided mentioning the open ports until now, because they might find different ways to hide if they know they are exposed.

[edited by: adrianTNT at 6:34 pm (utc) on Feb 8, 2020]

[adrianTNT]

207.244.103.158
104.244.158.128
66.78.16.60
45.58.46.12
45.58.40.179
192.154.215.22
85.203.49.24
185.211.147.220
23.239.183.18
23.239.178.129
107.182.239.124
192.210.179.229
2.56.20.126
38.86.228.78
107.161.18.21
199.195.142.205
173.211.35.28
38.130.180.84
23.108.67.18
191.96.242.134
38.123.121.143
216.158.196.188
192.154.242.22
45.32.216.70
199.195.192.31
104.223.93.197
208.51.63.227
192.154.242.214
65.181.113.147
184.174.10.124
104.37.27.220
185.198.25.60
192.103.252.10
38.130.180.9
23.239.178.12
192.154.242.150
198.240.124.124
216.126.228.10
31.220.30.61
104.223.93.196
23.226.209.173
38.131.171.138
192.3.18.23
104.164.45.64
107.161.169.125
5.253.87.183
104.168.117.6
46.19.143.137
192.186.135.155
23.105.70.81
38.64.55.192
207.66.34.254
45.76.69.88
198.240.127.60
198.23.158.87
185.144.156.208
104.238.146.83
192.3.182.215
185.211.147.252
68.233.46.61
192.154.215.54
185.208.236.188
104.37.26.220
23.27.145.156
192.3.18.19
185.172.53.124
45.63.77.239
107.163.234.112
64.140.140.44
31.220.30.91
198.240.72.92
104.237.1.177
23.249.228.156
104.237.1.111
185.202.170.12
209.141.34.211
107.163.234.144
38.130.161.17
104.128.226.229
144.172.68.237
162.219.31.110
45.79.69.120
185.173.109.124
104.207.132.171
168.235.67.162
104.168.117.12
138.0.242.32
107.163.234.16
72.19.15.181
38.130.176.226
194.31.151.94
85.203.48.88
23.108.67.24
74.114.118.188
185.197.28.28
198.37.121.89
192.154.215.0
45.58.52.43
173.211.35.109
158.222.115.4
216.126.231.221
193.31.34.60
38.130.180.54
216.126.231.142
185.47.44.233
69.51.25.225
207.66.25.62
185.202.170.45
85.203.49.56
50.116.58.205
45.58.49.209
198.8.93.22
38.130.178.126
104.168.101.131
38.130.161.113
85.203.51.18
192.210.180.177
185.174.253.156
45.32.223.213
38.83.9.148
207.244.103.188
185.173.109.252
192.154.246.70
173.211.35.220
69.12.93.222
194.93.53.156
162.211.67.63
38.133.120.234
45.58.49.210
23.227.133.226
38.94.198.238
66.187.76.178
23.254.202.70
104.223.109.219
38.133.120.170
107.191.102.97
172.82.128.138
64.140.142.60
184.174.10.60
38.130.161.209
198.37.121.20
172.245.217.8
104.164.45.96
38.94.198.206
162.219.29.183
167.160.35.114
216.246.212.42
158.222.125.254
192.154.242.118
198.23.225.239
191.101.200.138
38.95.185.5
23.226.209.109
193.31.34.156
38.128.108.242
38.133.120.10
38.132.200.30
45.32.167.223
199.38.242.227
185.211.147.28
194.31.151.190
75.127.10.61
23.239.183.242
173.211.35.173
198.37.96.10
216.126.228.8
64.140.142.188
173.211.35.13
138.0.242.224
192.154.215.24
23.27.146.60
107.174.133.232
172.105.158.60
104.168.35.234
185.174.253.28
45.63.91.30
158.222.125.222
185.202.170.156
198.23.247.140
74.114.118.124
181.177.80.30
38.133.120.138
209.242.196.40
194.93.53.92
198.240.124.92
45.61.105.18
158.222.115.164
104.243.195.250
45.58.48.218
207.66.31.254
38.111.164.64
198.8.93.23
104.168.117.38
23.108.72.18
69.12.93.66
185.170.197.92
23.249.228.220
151.236.22.61
172.93.174.224
23.239.84.149
162.253.176.6
185.209.253.252
172.93.52.220
38.133.120.106
38.64.56.78
206.124.104.47
38.97.133.28
185.215.227.48
185.198.25.124
192.210.218.189
64.140.140.12
107.161.169.124
198.12.104.229
104.223.109.218
216.246.212.10
64.251.15.158
193.234.224.36
173.211.35.205
23.239.183.50
104.37.26.25
23.105.70.179
104.251.219.233
108.62.49.61
69.12.93.158
104.200.16.250
138.0.242.17
173.248.186.131
205.185.127.148
207.244.103.187
38.111.164.160
98.158.179.61
107.163.234.48
45.59.121.186
185.209.253.220
167.160.36.44
107.174.27.6
38.111.164.224
69.12.93.254
162.217.249.190
185.211.147.60
199.167.29.125
104.243.195.154
66.78.16.28
45.76.169.173
167.160.36.36
104.164.45.128
38.131.171.234
38.129.103.210
209.242.196.176
23.254.204.131
104.37.26.98
23.108.72.15
23.254.203.176
185.173.109.60
173.211.35.252
45.59.126.148
38.130.176.91
104.168.90.39
173.247.238.165
167.88.124.203
198.46.251.5
198.240.69.220
69.50.232.204
198.23.158.88
107.181.156.128
5.226.169.127
76.8.60.130
185.34.43.10
104.223.82.31
199.195.142.206
185.174.253.220
38.129.103.18
144.172.68.234
104.207.151.3
38.111.164.239
72.19.15.182
198.240.124.28
209.135.132.164
38.111.164.32
38.130.176.81
206.124.104.111
198.240.65.156
38.64.55.224
198.240.124.60
216.158.196.28
198.23.225.240
185.172.53.252
216.21.9.217
200.189.44.136
195.38.1.124
45.61.111.18
104.251.216.134
23.95.227.166
192.252.223.15
192.186.163.42
209.192.135.46
185.202.170.28
206.124.104.30
185.170.197.28
184.174.10.220
192.210.179.234
104.168.35.222
185.198.25.156
38.64.56.46
185.208.236.156
38.86.228.46
167.160.34.48
38.106.120.38
192.210.213.135
107.163.234.240
65.181.122.15
23.27.145.220
155.94.66.228
198.240.123.28
209.141.43.110
38.127.127.98
162.216.17.188
104.168.90.54
45.61.105.123
2.56.20.62
193.31.34.124
38.133.120.202
185.197.28.156
199.167.202.101
104.168.61.224
144.172.68.232
23.239.178.131
38.97.133.124
198.240.127.92
38.129.103.82
198.240.69.60
162.253.177.10
23.108.72.183
38.106.120.166
200.189.44.8
38.109.10.142
185.202.170.11
107.181.156.241
38.97.133.60
38.111.164.207
76.8.60.242
216.126.224.188
104.224.65.252
45.58.48.219
191.96.242.130
185.215.227.47
45.32.223.29
173.248.186.66
199.167.30.184
23.239.180.6
216.21.9.226
192.241.149.233
38.127.124.137
167.160.34.16
69.50.232.12
185.198.25.92
74.114.118.60
45.58.55.50
107.191.103.174
191.101.200.129
104.223.82.30
74.208.159.196
104.224.65.28
207.66.34.94
23.105.129.212
167.160.35.97
45.58.47.7
23.27.146.124
200.189.46.254
38.86.229.20
200.189.46.20
96.8.120.161
104.224.65.188
216.246.212.74
23.226.209.13
38.109.10.78
192.210.135.163
185.72.156.80
69.12.74.189
50.2.81.136
45.61.111.82
23.94.244.36
107.191.108.176
23.239.180.2
207.244.104.148
209.242.196.8
23.227.133.225
38.109.10.46
107.191.125.224
45.79.113.187
38.86.229.52
185.72.156.83
172.93.174.192
158.222.115.85
68.233.46.14
173.248.186.227
38.83.11.140
45.58.45.186
200.189.44.40
23.92.53.205
45.59.126.13
198.23.231.99
107.181.156.113
23.239.178.3
107.163.234.80
23.108.72.201
38.130.176.6
185.174.253.60
23.249.228.188
65.181.125.103
69.12.74.19
162.253.176.231
162.211.67.14
104.207.132.222
199.167.29.101
104.207.158.70
207.244.104.184
38.90.148.14
45.76.169.76
167.160.34.208
198.240.125.220
45.61.105.178
172.82.145.4
185.172.53.220
207.66.3.94
192.154.215.246
173.211.35.92
195.38.1.156
185.34.43.17
74.114.118.28
85.203.50.38
194.93.53.188
198.240.125.28
185.173.109.220
198.37.99.108
162.253.176.249
38.127.124.113
206.124.104.79
38.128.109.210
198.37.99.204
38.127.127.44
75.127.10.57
209.95.48.192
185.202.170.188
85.203.51.50
185.174.253.252
209.242.196.72
194.31.151.126
162.219.30.141
209.141.60.162
64.140.142.124
23.92.53.203
38.64.101.18
45.79.226.139
66.78.17.224
38.90.148.110
192.210.139.121
185.198.25.220
38.123.121.32
185.208.236.252
207.66.29.254
192.103.252.105
185.34.43.19
207.244.103.159
38.64.102.14
198.240.65.60
45.61.105.146
23.95.226.182
45.79.206.66
23.27.146.156
209.192.135.91
162.217.248.59
185.202.170.60
5.253.87.184
209.99.143.124
206.124.104.94
207.66.29.30
38.86.228.31
38.127.124.107
192.154.246.0
23.27.145.252
45.59.126.203
45.61.111.146
185.173.109.28
38.64.101.146
65.181.127.18
185.198.25.188
185.208.236.28
38.123.121.17
45.79.168.30
45.77.213.108
104.145.232.5
194.31.151.222
38.97.133.13
76.8.60.241
38.83.9.52
185.202.170.10
158.222.115.228
207.66.31.190
104.207.159.148
104.145.232.98
104.36.80.20
23.92.53.211
216.158.196.220
162.253.178.52
23.94.55.62
45.61.105.210
104.223.93.198
185.209.253.60
45.59.126.38
104.244.158.127
45.58.49.120
185.197.28.92
192.154.246.102
23.92.89.245
23.94.48.180
199.21.112.251
199.83.103.120
104.168.170.241
185.217.149.188
198.23.235.51
154.49.206.28
185.217.149.156
162.216.227.16
23.108.67.197
198.240.124.156
192.154.246.134
185.217.149.28
69.51.21.36
38.106.120.70
206.217.133.141
38.90.148.238
45.79.76.164
185.202.170.220
38.97.133.237
38.64.102.78
162.217.248.69
155.94.66.229
45.63.68.132
185.197.28.60
45.5.66.14
38.130.161.239
45.32.139.17
204.27.59.242
38.130.180.124
23.108.67.177
207.66.29.62
38.111.164.0
172.93.50.240
5.253.87.185
107.191.118.114
65.181.122.152
209.242.196.200
74.208.169.168
45.79.176.87
198.240.65.28
64.140.142.92
168.235.86.13
172.245.58.248
198.240.127.156
207.66.25.47
199.83.103.129
104.156.252.114
155.94.209.205
162.211.67.227
198.37.99.44
38.109.10.14
45.58.49.116
104.224.65.156
104.224.65.220
185.172.53.188
185.202.170.124
45.59.126.220
45.63.78.156
173.248.186.98
23.239.183.114
192.210.179.239
192.154.242.86
167.160.34.97
69.51.21.35
142.93.112.206
45.61.111.50
209.192.135.42
185.174.253.92
23.226.209.45
75.127.10.102
192.241.210.66
207.66.25.179
155.94.66.230
45.32.230.12
174.127.124.27
181.177.80.254
192.252.223.12
38.64.101.114
207.244.103.160
198.240.68.28
69.51.25.226
198.240.70.92
66.78.16.252
45.59.126.219
23.227.133.227
185.172.53.60
158.222.125.158
173.211.35.156
198.12.127.137
69.12.93.34
107.163.234.208
172.245.217.79
38.133.120.74
216.158.196.92
23.226.237.251
107.182.239.53
104.207.146.148
185.217.149.220
207.66.29.222
38.64.56.14
173.211.35.124
38.127.124.125
162.253.176.199
192.103.252.104
192.3.18.15
185.47.44.71
104.37.28.28
104.237.1.112
45.58.49.208
173.247.238.163
184.174.10.222
38.83.9.20
181.177.80.158
38.90.148.174
167.160.35.212
209.99.144.124
38.130.161.77
45.79.1.56
104.224.65.60
198.23.155.61
38.83.9.180
45.76.170.196
207.66.31.222
69.51.16.177
198.240.122.156
75.102.38.250
198.23.135.218
173.211.35.141
208.51.63.228
185.211.147.124
144.172.68.233
107.181.156.81
104.168.170.247
38.132.200.62
38.64.101.50
185.34.43.20
38.109.10.110
23.94.55.64
216.21.9.208
23.239.2.89
104.243.195.186
69.12.93.115
158.222.125.30
104.37.26.29
2.56.20.94
216.21.9.169
207.66.34.222
45.5.65.254
107.175.94.133
104.164.45.32
185.209.253.156
104.168.117.70
68.233.46.62
198.74.51.71
38.129.103.242
209.208.97.172
173.247.238.166
185.172.53.92
107.191.101.219
104.37.27.10
198.37.121.204
38.83.9.212
162.211.64.39
198.23.135.219
38.94.198.14
162.253.176.92
38.123.121.209
172.245.217.88
104.37.27.251
195.38.1.92
45.58.49.53
85.203.50.70
96.8.113.39
192.154.242.0
23.254.201.181
38.128.109.178
38.129.103.146
184.174.10.252
198.23.247.139
104.36.83.244
198.46.230.112
198.37.121.23
23.226.209.205
45.5.65.30
138.68.26.139
185.197.28.188
185.34.43.21
185.197.28.220
138.0.242.96
38.83.11.172
192.154.246.230
185.202.170.252
162.217.248.64
107.181.156.98
104.129.41.48
209.99.144.60
205.185.113.173
185.217.149.92
192.154.246.6
200.189.44.104
209.242.196.232
198.240.71.188
199.195.250.148
45.32.199.75
198.37.96.223
38.127.124.131
104.37.28.96
45.59.126.15
198.240.122.92
104.168.35.233
207.66.29.158
104.243.195.26
172.93.174.160
23.239.178.1
107.161.18.152
207.244.104.150
173.255.209.95
204.27.60.120
104.243.195.90
23.27.145.188
168.235.94.63
69.50.232.44
38.129.103.114
66.85.185.67
23.249.228.60
191.101.200.142
154.49.206.60
158.222.115.132
192.154.215.56
38.130.178.96
179.43.169.37
199.21.112.246
198.23.255.3
45.59.126.79
38.130.176.76
38.130.176.241
192.154.215.120
104.251.219.232
138.0.242.128
64.140.142.156
172.245.217.89
45.61.105.82
38.127.127.70
185.202.170.13
107.181.156.66
185.197.28.252
38.83.9.116
45.58.49.36
38.64.55.145
74.114.118.252
155.94.66.238
172.245.132.220
199.83.103.119
103.196.180.101
192.227.233.32
38.130.180.60
194.93.53.124
38.86.229.84
192.154.242.182
206.124.104.62
64.251.21.52
155.94.209.203
216.158.196.156
38.97.133.220
184.174.10.62
104.245.36.205
38.131.171.10
199.167.29.18
158.222.125.190
181.177.80.62
104.245.36.180
38.83.9.244
38.86.229.46
104.224.65.92
162.253.177.19
185.173.109.188
172.245.248.79
69.12.93.190
207.66.34.30
206.124.104.15
66.78.17.160
185.198.25.28
216.126.231.175
65.181.113.150
168.235.96.104
198.7.57.93
45.79.198.99
23.249.228.92
185.197.28.124
216.126.231.194
167.160.34.144
85.203.50.6
168.235.65.3
45.32.168.121
23.249.228.252
207.66.25.194
23.105.70.83
162.216.224.22
38.127.124.143
23.108.72.219
38.97.133.252
104.168.170.242
159.203.86.210
45.79.92.135
38.130.161.47
185.211.147.92
185.208.236.60
75.127.10.48
23.108.72.89
69.12.74.190
172.93.174.128
207.66.31.158
198.46.156.186
5.253.87.182
172.93.52.221
38.86.229.244
184.174.10.92
104.251.219.234
104.168.117.102
45.59.121.185
104.251.219.129
168.235.87.209
38.127.127.72
107.191.126.112
45.59.126.10
104.168.101.130
107.161.17.135
207.244.104.147
38.83.9.84
207.66.3.62
200.189.46.222
45.59.119.29
167.160.35.195
209.208.109.22
173.211.35.45
50.2.81.135
185.209.253.124
207.66.29.190
69.50.232.236
107.181.156.226
192.210.180.165
185.202.170.92
216.126.224.184
184.174.10.126
69.50.232.76
185.172.53.156
103.196.180.102
155.94.66.231
69.87.218.112
167.160.35.16
104.168.170.221
104.37.28.124
185.208.236.92
199.83.103.108
50.22.186.222
38.130.180.69
181.177.80.126
216.126.225.147
200.189.44.72
31.220.30.90
23.229.8.19
198.46.251.51
198.23.148.177
198.46.251.52
198.240.125.252
209.242.196.208
193.31.34.188
185.211.147.188
85.203.51.178
65.181.122.155
45.59.126.87
199.83.103.121
38.130.178.111
85.203.48.56
209.99.143.60
66.78.17.128
173.248.186.34
195.38.1.28
173.247.238.164
65.111.180.137
45.61.105.50
207.66.3.30
38.128.109.242
138.0.242.160
209.135.132.165
181.177.80.222
104.224.65.124
38.127.124.101
138.68.43.77
184.174.10.30
185.173.109.92
107.163.234.176
64.140.142.28
5.226.169.117
103.196.180.100
23.92.53.215
23.227.133.224
85.203.49.62
162.211.66.32
185.202.170.14
104.243.195.218
207.66.29.94
38.127.127.97
192.154.246.198
23.92.89.253
38.130.178.141
104.223.93.199
75.127.10.62
107.161.169.123
198.46.251.10
172.82.145.31
45.58.55.49
168.235.65.125
185.173.109.156
104.37.27.42
45.79.13.132
2.56.20.158
216.119.148.72
207.66.25.15
162.253.178.14
204.27.60.124
138.0.242.192
198.58.111.58
185.172.53.28
38.133.120.42
45.63.19.185
172.93.174.0
209.192.135.59
5.226.169.134
216.158.196.60
107.161.169.197
85.203.51.242
38.90.148.78
45.5.65.222
198.240.72.156
198.46.230.191
104.243.195.122
38.123.121.113
96.8.120.160
45.63.11.12
104.223.107.45
185.144.156.201
207.66.25.113
38.130.176.9
69.60.98.13
103.246.248.234
185.198.26.248
23.249.228.124
38.64.102.46
38.90.148.142
85.203.48.24
198.23.150.43
38.123.121.128
104.244.158.123
154.49.206.92
38.130.180.24
172.245.38.147
104.223.109.207
38.83.11.44
199.167.28.226
45.61.105.114
74.114.118.92
45.32.201.132
192.154.215.88
198.240.123.252
45.59.121.184
209.99.143.92
104.164.45.224
38.111.164.192
198.23.247.141
198.240.67.220
45.63.109.34
185.211.147.156
168.235.67.109
209.95.48.212
66.85.186.233
23.226.209.237
192.103.252.107
38.127.127.51
185.209.253.92
104.237.1.110
23.249.228.28
198.37.121.8
185.198.25.252
23.239.84.157
209.242.196.104
45.63.68.199
181.177.80.190
66.78.17.192
193.234.224.248
45.5.66.110
185.72.156.82
23.108.72.16
173.211.35.60
23.94.55.63
185.208.236.220
184.174.10.28
38.123.121.158
198.134.126.85
198.46.251.48
198.134.126.137
184.174.10.156
191.96.242.132
162.253.177.238
192.154.246.38
184.174.10.158
144.202.86.207
216.158.196.252
198.98.49.218
167.160.36.39
198.12.127.139
198.240.127.124
104.164.45.192
107.191.105.202
216.158.196.124
23.105.70.113
38.127.127.99
198.46.251.50
104.223.109.216
144.172.68.236
167.71.98.211
65.181.113.143
38.130.178.156
185.215.227.45
162.211.67.64
23.226.209.77
104.164.45.0
104.128.239.180
23.94.49.67
23.27.146.28
38.83.11.12
167.160.36.43
185.217.149.252
207.66.34.62
172.245.217.87
198.57.46.215
198.240.71.156
192.154.242.54
216.126.228.9
162.211.67.226
185.202.170.77
199.167.202.136
104.217.62.113
144.172.68.235
184.174.10.188
209.99.144.156
198.37.99.76
144.202.86.238
185.174.253.188
104.153.82.51
38.130.161.143
184.164.147.10
38.130.180.45
198.240.71.124
85.203.51.210
69.12.93.98
185.72.156.81
45.58.32.162
184.174.10.94
205.185.117.201
23.239.180.10
207.66.29.126
66.85.186.235
69.50.232.108
185.217.149.60
45.5.66.142
162.253.178.202
104.164.45.160
45.58.46.23
198.240.123.220
38.128.108.18
45.59.126.142
69.50.232.172
155.94.66.226
107.174.133.233
185.170.197.60
45.61.111.114
204.145.72.159
194.93.53.60
38.83.11.108
38.64.101.82
104.37.28.2
216.126.224.178
181.177.80.94
69.51.6.6
158.222.115.100
185.174.253.124
198.134.126.84
107.191.125.23
198.37.99.12
45.59.116.78
158.222.115.53
192.252.223.13
198.240.71.220
66.85.185.92
173.44.42.75
45.63.34.209
65.181.112.202
198.8.93.24
38.127.127.43
38.130.161.173
23.239.183.0
23.27.146.92
38.90.148.206
198.240.123.188
107.191.101.63
38.90.148.46
64.140.140.76
38.123.121.194
66.187.76.27
38.83.11.204
198.23.230.217
104.37.27.74
107.191.96.159
23.239.183.210
198.23.231.123
45.5.66.46
198.199.107.69
206.124.104.126
64.140.142.252
198.12.67.32
198.37.121.108
184.174.10.190
74.114.118.220
185.208.236.124
159.203.142.127
38.106.120.198
38.129.103.50
85.203.49.94
207.66.31.30
198.37.121.17
207.244.104.149
104.168.35.230
172.245.132.222
173.211.35.77
23.105.70.176
76.8.60.140
108.61.222.106
23.226.209.141
23.105.70.86
168.235.91.225
198.23.230.178
107.181.156.96
38.106.120.6
198.240.70.60
104.238.153.175
198.37.121.172
162.253.177.240
172.245.58.253
104.156.229.32
209.99.144.28
69.51.25.227
23.105.70.82
207.66.25.30
173.248.186.19
207.244.104.183
69.51.6.50
45.59.126.209
174.127.124.28
107.161.17.162
209.192.135.74
38.83.11.236
66.85.139.196
38.106.120.102
66.78.17.96
104.244.158.126
172.245.38.148
185.215.227.46
198.23.150.44
158.222.115.196
64.140.142.220
198.57.46.229
198.240.71.252
216.126.231.177
45.79.213.90
38.130.176.66
38.64.55.128
194.31.151.30
104.37.26.4
198.240.122.124
207.244.97.185
104.243.195.58
38.129.103.32
45.5.66.78
45.32.222.244
185.217.149.124
104.251.216.135
38.106.120.134
107.191.105.181
185.144.156.188
173.248.186.3
207.66.25.128
38.83.11.76
209.99.144.92
199.38.242.232
38.97.133.92
23.239.183.82
173.211.35.188
23.108.72.241
38.127.124.119
69.51.13.45
168.235.91.51
172.93.52.19
192.210.218.190
199.167.30.187
23.27.145.28
23.226.237.250
104.37.28.17
199.167.28.216
216.126.231.196
138.0.242.64
198.46.251.49
107.191.102.228
209.208.110.100
107.175.94.138
193.31.34.92
74.114.118.156
38.106.120.230
198.240.72.28
162.253.178.244
192.227.251.208
173.248.186.195
69.50.232.140
162.211.64.40
209.208.108.68
185.144.156.204
185.209.253.188
198.12.127.142
23.229.8.20
38.132.200.94
23.239.183.146
104.227.138.114
198.240.123.60
38.95.185.2
198.46.251.11
185.209.253.28
162.211.66.17

[lammert]

These can just be genuine Squid proxies of several different owners that have been badly configured and secured by their respective administrators and are now abused by others. Do these proxies send an X-Forwarded-For header which identifies the original source of the request?

[adrianTNT]

I should have looked closer at that forwarding headers, but I didn't, now they are blocked.
My site is already configured to get real user IP if these headers exist, so this must be only ip header, a live chat app also shown it as single IP, others like some Google proxy appear with comma: x.x.x.x, z.z.z.z.

The screen resolution was the same for all, so there are not multiple users using these, and this makes me think they are not some VPNs, unless some 3rd party browser is having real users, but actually gets url contents by these proxies and using same screen resolution and user agent, anyone ever seen that ?

The site is an android downloads related site, 80% of users are on mobile devices, I will add this to initial topic.

[lucy24]

If they have a recognizable unifying feature that isn't shared by humans, block 'em.

We would all like to know what robots are up to ... but honestly, sometimes I suspect the robots themselves don't know. For all I know, some of them may operate like an old-fashioned clippings service: collect the information, hand it over to whoever is paying, and think no more about it.

Blocking individual aa.bb.cc.dd addresses may sometimes be appropriate if it's a human IP that has been compromised. But for datacenters it makes little sense to look at anything less than the full range, which can be from /22 on up.

[not2easy]

Several of those are plain old server farms that are listed here in the forums. Here's the problem though. Individual IPs are not listed, if you search for any single IP here you will only very rarely find it. The format we use comes from after you've done the basic lookups so that you can search for a range or a CIDR. The format would be like:
LINODE
23.92.16.0 - 23.92.31.255
CIDR: 23.92.16.0/20

WEB2OBJECTS
45.61.64.0 - 45.61.127.255
CIDR: 45.61.64.0/18

In your list, blocking the CIDR: "45.61.64.0/18", would knock out 14 of those unwanted bots and their cousins. Of course you should only block traffic from IPs after you have investigated your own access logs to verify that those are not actual humans.

Note that if you aren't sure how you can see the headers mentioned by lammert, search for robot headers and the instructions can be found: [webmasterworld.com...]

Most of those are listed here and blocked due to scrapers hosted on those ranges. I did not do a complete analysis but most of this list can be broken down easier if you first sort the list, then run a lookup. It is a waste of time to block individual IPs but even a short list of CIDRs can block tens of thousands of unwanted bots. Understanding the headers gives you tools to sort people from bots.

[Jonesy]

Just for grins...
Taking the list of IP's given by the OP and running them through
the Linux/FreeBSD utility `aggregate` reduced the size of the list
from 1254 to 1192 -- so quite a few IP's were immediate neighbors.
Lots of /31 and several /30.

[adrianTNT]

Same list, sorted alphabetically, (could not edit above post anymore)

103.196.180.100
103.196.180.101
103.196.180.102
103.246.248.234
104.128.226.229
104.128.239.180
104.129.41.48
104.145.232.5
104.145.232.98
104.153.82.51
104.156.229.32
104.156.252.114
104.164.45.0
104.164.45.128
104.164.45.160
104.164.45.192
104.164.45.224
104.164.45.32
104.164.45.64
104.164.45.96
104.168.101.130
104.168.101.131
104.168.117.102
104.168.117.12
104.168.117.38
104.168.117.6
104.168.117.70
104.168.170.221
104.168.170.241
104.168.170.242
104.168.170.247
104.168.35.222
104.168.35.230
104.168.35.233
104.168.35.234
104.168.61.224
104.168.90.39
104.168.90.54
104.200.16.250
104.207.132.171
104.207.132.222
104.207.146.148
104.207.151.3
104.207.158.70
104.207.159.148
104.217.62.113
104.223.107.45
104.223.109.207
104.223.109.216
104.223.109.218
104.223.109.219
104.223.82.30
104.223.82.31
104.223.93.196
104.223.93.197
104.223.93.198
104.223.93.199
104.224.65.124
104.224.65.156
104.224.65.188
104.224.65.220
104.224.65.252
104.224.65.28
104.224.65.60
104.224.65.92
104.227.138.114
104.237.1.110
104.237.1.111
104.237.1.112
104.237.1.177
104.238.146.83
104.238.153.175
104.243.195.122
104.243.195.154
104.243.195.186
104.243.195.218
104.243.195.250
104.243.195.26
104.243.195.58
104.243.195.90
104.244.158.123
104.244.158.126
104.244.158.127
104.244.158.128
104.245.36.180
104.245.36.205
104.251.216.134
104.251.216.135
104.251.219.129
104.251.219.232
104.251.219.233
104.251.219.234
104.36.80.20
104.36.83.244
104.37.26.220
104.37.26.25
104.37.26.29
104.37.26.4
104.37.26.98
104.37.27.10
104.37.27.220
104.37.27.251
104.37.27.42
104.37.27.74
104.37.28.124
104.37.28.17
104.37.28.2
104.37.28.28
104.37.28.96
107.161.169.123
107.161.169.124
107.161.169.125
107.161.169.197
107.161.17.135
107.161.17.162
107.161.18.152
107.161.18.21
107.163.234.112
107.163.234.144
107.163.234.16
107.163.234.176
107.163.234.208
107.163.234.240
107.163.234.48
107.163.234.80
107.174.133.232
107.174.133.233
107.174.27.6
107.175.94.133
107.175.94.138
107.181.156.113
107.181.156.128
107.181.156.226
107.181.156.241
107.181.156.66
107.181.156.81
107.181.156.96
107.181.156.98
107.182.239.124
107.182.239.53
107.191.101.219
107.191.101.63
107.191.102.228
107.191.102.97
107.191.103.174
107.191.105.181
107.191.105.202
107.191.108.176
107.191.118.114
107.191.125.224
107.191.125.23
107.191.126.112
107.191.96.159
108.61.222.106
108.62.49.61
138.0.242.128
138.0.242.160
138.0.242.17
138.0.242.192
138.0.242.224
138.0.242.32
138.0.242.64
138.0.242.96
138.68.26.139
138.68.43.77
142.93.112.206
144.172.68.232
144.172.68.233
144.172.68.234
144.172.68.235
144.172.68.236
144.172.68.237
144.202.86.207
144.202.86.238
151.236.22.61
154.49.206.28
154.49.206.60
154.49.206.92
155.94.209.203
155.94.209.205
155.94.66.226
155.94.66.228
155.94.66.229
155.94.66.230
155.94.66.231
155.94.66.238
158.222.115.100
158.222.115.132
158.222.115.164
158.222.115.196
158.222.115.228
158.222.115.4
158.222.115.53
158.222.115.85
158.222.125.158
158.222.125.190
158.222.125.222
158.222.125.254
158.222.125.30
159.203.142.127
159.203.86.210
162.211.64.39
162.211.64.40
162.211.66.17
162.211.66.32
162.211.67.14
162.211.67.226
162.211.67.227
162.211.67.63
162.211.67.64
162.216.17.188
162.216.224.22
162.216.227.16
162.217.248.59
162.217.248.64
162.217.248.69
162.217.249.190
162.219.29.183
162.219.30.141
162.219.31.110
162.253.176.199
162.253.176.231
162.253.176.249
162.253.176.6
162.253.176.92
162.253.177.10
162.253.177.19
162.253.177.238
162.253.177.240
162.253.178.14
162.253.178.202
162.253.178.244
162.253.178.52
167.160.34.144
167.160.34.16
167.160.34.208
167.160.34.48
167.160.34.97
167.160.35.114
167.160.35.16
167.160.35.195
167.160.35.212
167.160.35.97
167.160.36.36
167.160.36.39
167.160.36.43
167.160.36.44
167.71.98.211
167.88.124.203
168.235.65.125
168.235.65.3
168.235.67.109
168.235.67.162
168.235.86.13
168.235.87.209
168.235.91.225
168.235.91.51
168.235.94.63
168.235.96.104
172.105.158.60
172.245.132.220
172.245.132.222
172.245.217.79
172.245.217.8
172.245.217.87
172.245.217.88
172.245.217.89
172.245.248.79
172.245.38.147
172.245.38.148
172.245.58.248
172.245.58.253
172.82.128.138
172.82.145.31
172.82.145.4
172.93.174.0
172.93.174.128
172.93.174.160
172.93.174.192
172.93.174.224
172.93.50.240
172.93.52.19
172.93.52.220
172.93.52.221
173.211.35.109
173.211.35.124
173.211.35.13
173.211.35.141
173.211.35.156
173.211.35.173
173.211.35.188
173.211.35.205
173.211.35.220
173.211.35.252
173.211.35.28
173.211.35.45
173.211.35.60
173.211.35.77
173.211.35.92
173.247.238.163
173.247.238.164
173.247.238.165
173.247.238.166
173.248.186.131
173.248.186.19
173.248.186.195
173.248.186.227
173.248.186.3
173.248.186.34
173.248.186.66
173.248.186.98
173.255.209.95
173.44.42.75
174.127.124.27
174.127.124.28
179.43.169.37
181.177.80.126
181.177.80.158
181.177.80.190
181.177.80.222
181.177.80.254
181.177.80.30
181.177.80.62
181.177.80.94
184.164.147.10
184.174.10.124
184.174.10.126
184.174.10.156
184.174.10.158
184.174.10.188
184.174.10.190
184.174.10.220
184.174.10.222
184.174.10.252
184.174.10.28
184.174.10.30
184.174.10.60
184.174.10.62
184.174.10.92
184.174.10.94
185.144.156.188
185.144.156.201
185.144.156.204
185.144.156.208
185.170.197.28
185.170.197.60
185.170.197.92
185.172.53.124
185.172.53.156
185.172.53.188
185.172.53.220
185.172.53.252
185.172.53.28
185.172.53.60
185.172.53.92
185.173.109.124
185.173.109.156
185.173.109.188
185.173.109.220
185.173.109.252
185.173.109.28
185.173.109.60
185.173.109.92
185.174.253.124
185.174.253.156
185.174.253.188
185.174.253.220
185.174.253.252
185.174.253.28
185.174.253.60
185.174.253.92
185.197.28.124
185.197.28.156
185.197.28.188
185.197.28.220
185.197.28.252
185.197.28.28
185.197.28.60
185.197.28.92
185.198.25.124
185.198.25.156
185.198.25.188
185.198.25.220
185.198.25.252
185.198.25.28
185.198.25.60
185.198.25.92
185.198.26.248
185.202.170.10
185.202.170.11
185.202.170.12
185.202.170.124
185.202.170.13
185.202.170.14
185.202.170.156
185.202.170.188
185.202.170.220
185.202.170.252
185.202.170.28
185.202.170.45
185.202.170.60
185.202.170.77
185.202.170.92
185.208.236.124
185.208.236.156
185.208.236.188
185.208.236.220
185.208.236.252
185.208.236.28
185.208.236.60
185.208.236.92
185.209.253.124
185.209.253.156
185.209.253.188
185.209.253.220
185.209.253.252
185.209.253.28
185.209.253.60
185.209.253.92
185.211.147.124
185.211.147.156
185.211.147.188
185.211.147.220
185.211.147.252
185.211.147.28
185.211.147.60
185.211.147.92
185.215.227.45
185.215.227.46
185.215.227.47
185.215.227.48
185.217.149.124
185.217.149.156
185.217.149.188
185.217.149.220
185.217.149.252
185.217.149.28
185.217.149.60
185.217.149.92
185.34.43.10
185.34.43.17
185.34.43.19
185.34.43.20
185.34.43.21
185.47.44.233
185.47.44.71
185.72.156.80
185.72.156.81
185.72.156.82
185.72.156.83
191.101.200.129
191.101.200.138
191.101.200.142
191.96.242.130
191.96.242.132
191.96.242.134
192.103.252.10
192.103.252.104
192.103.252.105
192.103.252.107
192.154.215.0
192.154.215.120
192.154.215.22
192.154.215.24
192.154.215.246
192.154.215.54
192.154.215.56
192.154.215.88
192.154.242.0
192.154.242.118
192.154.242.150
192.154.242.182
192.154.242.214
192.154.242.22
192.154.242.54
192.154.242.86
192.154.246.0
192.154.246.102
192.154.246.134
192.154.246.198
192.154.246.230
192.154.246.38
192.154.246.6
192.154.246.70
192.186.135.155
192.186.163.42
192.210.135.163
192.210.139.121
192.210.179.229
192.210.179.234
192.210.179.239
192.210.180.165
192.210.180.177
192.210.213.135
192.210.218.189
192.210.218.190
192.227.233.32
192.227.251.208
192.241.149.233
192.241.210.66
192.252.223.12
192.252.223.13
192.252.223.15
192.3.18.15
192.3.18.19
192.3.18.23
192.3.182.215
193.234.224.248
193.234.224.36
193.31.34.124
193.31.34.156
193.31.34.188
193.31.34.60
193.31.34.92
194.31.151.126
194.31.151.190
194.31.151.222
194.31.151.30
194.31.151.94
194.93.53.124
194.93.53.156
194.93.53.188
194.93.53.60
194.93.53.92
195.38.1.124
195.38.1.156
195.38.1.28
195.38.1.92
198.12.104.229
198.12.127.137
198.12.127.139
198.12.127.142
198.12.67.32
198.134.126.137
198.134.126.84
198.134.126.85
198.199.107.69
198.23.135.218
198.23.135.219
198.23.148.177
198.23.150.43
198.23.150.44
198.23.155.61
198.23.158.87
198.23.158.88
198.23.225.239
198.23.225.240
198.23.230.178
198.23.230.217
198.23.231.123
198.23.231.99
198.23.235.51
198.23.247.139
198.23.247.140
198.23.247.141
198.23.255.3
198.240.122.124
198.240.122.156
198.240.122.92
198.240.123.188
198.240.123.220
198.240.123.252
198.240.123.28
198.240.123.60
198.240.124.124
198.240.124.156
198.240.124.28
198.240.124.60
198.240.124.92
198.240.125.220
198.240.125.252
198.240.125.28
198.240.127.124
198.240.127.156
198.240.127.60
198.240.127.92
198.240.65.156
198.240.65.28
198.240.65.60
198.240.67.220
198.240.68.28
198.240.69.220
198.240.69.60
198.240.70.60
198.240.70.92
198.240.71.124
198.240.71.156
198.240.71.188
198.240.71.220
198.240.71.252
198.240.72.156
198.240.72.28
198.240.72.92
198.37.121.108
198.37.121.17
198.37.121.172
198.37.121.20
198.37.121.204
198.37.121.23
198.37.121.8
198.37.121.89
198.37.96.10
198.37.96.223
198.37.99.108
198.37.99.12
198.37.99.204
198.37.99.44
198.37.99.76
198.46.156.186
198.46.230.112
198.46.230.191
198.46.251.10
198.46.251.11
198.46.251.48
198.46.251.49
198.46.251.5
198.46.251.50
198.46.251.51
198.46.251.52
198.57.46.215
198.57.46.229
198.58.111.58
198.7.57.93
198.74.51.71
198.8.93.22
198.8.93.23
198.8.93.24
198.98.49.218
199.167.202.101
199.167.202.136
199.167.28.216
199.167.28.226
199.167.29.101
199.167.29.125
199.167.29.18
199.167.30.184
199.167.30.187
199.195.142.205
199.195.142.206
199.195.192.31
199.195.250.148
199.21.112.246
199.21.112.251
199.38.242.227
199.38.242.232
199.83.103.108
199.83.103.119
199.83.103.120
199.83.103.121
199.83.103.129
2.56.20.126
2.56.20.158
2.56.20.62
2.56.20.94
200.189.44.104
200.189.44.136
200.189.44.40
200.189.44.72
200.189.44.8
200.189.46.20
200.189.46.222
200.189.46.254
204.145.72.159
204.27.59.242
204.27.60.120
204.27.60.124
205.185.113.173
205.185.117.201
205.185.127.148
206.124.104.111
206.124.104.126
206.124.104.15
206.124.104.30
206.124.104.47
206.124.104.62
206.124.104.79
206.124.104.94
206.217.133.141
207.244.103.158
207.244.103.159
207.244.103.160
207.244.103.187
207.244.103.188
207.244.104.147
207.244.104.148
207.244.104.149
207.244.104.150
207.244.104.183
207.244.104.184
207.244.97.185
207.66.25.113
207.66.25.128
207.66.25.15
207.66.25.179
207.66.25.194
207.66.25.30
207.66.25.47
207.66.25.62
207.66.29.126
207.66.29.158
207.66.29.190
207.66.29.222
207.66.29.254
207.66.29.30
207.66.29.62
207.66.29.94
207.66.3.30
207.66.3.62
207.66.3.94
207.66.31.158
207.66.31.190
207.66.31.222
207.66.31.254
207.66.31.30
207.66.34.222
207.66.34.254
207.66.34.30
207.66.34.62
207.66.34.94
208.51.63.227
208.51.63.228
209.135.132.164
209.135.132.165
209.141.34.211
209.141.43.110
209.141.60.162
209.192.135.42
209.192.135.46
209.192.135.59
209.192.135.74
209.192.135.91
209.208.108.68
209.208.109.22
209.208.110.100
209.208.97.172
209.242.196.104
209.242.196.176
209.242.196.200
209.242.196.208
209.242.196.232
209.242.196.40
209.242.196.72
209.242.196.8
209.95.48.192
209.95.48.212
209.99.143.124
209.99.143.60
209.99.143.92
209.99.144.124
209.99.144.156
209.99.144.28
209.99.144.60
209.99.144.92
216.119.148.72
216.126.224.178
216.126.224.184
216.126.224.188
216.126.225.147
216.126.228.10
216.126.228.8
216.126.228.9
216.126.231.142
216.126.231.175
216.126.231.177
216.126.231.194
216.126.231.196
216.126.231.221
216.158.196.124
216.158.196.156
216.158.196.188
216.158.196.220
216.158.196.252
216.158.196.28
216.158.196.60
216.158.196.92
216.21.9.169
216.21.9.208
216.21.9.217
216.21.9.226
216.246.212.10
216.246.212.42
216.246.212.74
23.105.129.212
23.105.70.113
23.105.70.176
23.105.70.179
23.105.70.81
23.105.70.82
23.105.70.83
23.105.70.86
23.108.67.177
23.108.67.18
23.108.67.197
23.108.67.24
23.108.72.15
23.108.72.16
23.108.72.18
23.108.72.183
23.108.72.201
23.108.72.219
23.108.72.241
23.108.72.89
23.226.209.109
23.226.209.13
23.226.209.141
23.226.209.173
23.226.209.205
23.226.209.237
23.226.209.45
23.226.209.77
23.226.237.250
23.226.237.251
23.227.133.224
23.227.133.225
23.227.133.226
23.227.133.227
23.229.8.19
23.229.8.20
23.239.178.1
23.239.178.12
23.239.178.129
23.239.178.131
23.239.178.3
23.239.180.10
23.239.180.2
23.239.180.6
23.239.183.0
23.239.183.114
23.239.183.146
23.239.183.18
23.239.183.210
23.239.183.242
23.239.183.50
23.239.183.82
23.239.2.89
23.239.84.149
23.239.84.157
23.249.228.124
23.249.228.156
23.249.228.188
23.249.228.220
23.249.228.252
23.249.228.28
23.249.228.60
23.249.228.92
23.254.201.181
23.254.202.70
23.254.203.176
23.254.204.131
23.27.145.156
23.27.145.188
23.27.145.220
23.27.145.252
23.27.145.28
23.27.146.124
23.27.146.156
23.27.146.28
23.27.146.60
23.27.146.92
23.92.53.203
23.92.53.205
23.92.53.211
23.92.53.215
23.92.89.245
23.92.89.253
23.94.244.36
23.94.48.180
23.94.49.67
23.94.55.62
23.94.55.63
23.94.55.64
23.95.226.182
23.95.227.166
31.220.30.61
31.220.30.90
31.220.30.91
38.106.120.102
38.106.120.134
38.106.120.166
38.106.120.198
38.106.120.230
38.106.120.38
38.106.120.6
38.106.120.70
38.109.10.110
38.109.10.14
38.109.10.142
38.109.10.46
38.109.10.78
38.111.164.0
38.111.164.160
38.111.164.192
38.111.164.207
38.111.164.224
38.111.164.239
38.111.164.32
38.111.164.64
38.123.121.113
38.123.121.128
38.123.121.143
38.123.121.158
38.123.121.17
38.123.121.194
38.123.121.209
38.123.121.32
38.127.124.101
38.127.124.107
38.127.124.113
38.127.124.119
38.127.124.125
38.127.124.131
38.127.124.137
38.127.124.143
38.127.127.43
38.127.127.44
38.127.127.51
38.127.127.70
38.127.127.72
38.127.127.97
38.127.127.98
38.127.127.99
38.128.108.18
38.128.108.242
38.128.109.178
38.128.109.210
38.128.109.242
38.129.103.114
38.129.103.146
38.129.103.18
38.129.103.210
38.129.103.242
38.129.103.32
38.129.103.50
38.129.103.82
38.130.161.113
38.130.161.143
38.130.161.17
38.130.161.173
38.130.161.209
38.130.161.239
38.130.161.47
38.130.161.77
38.130.176.226
38.130.176.241
38.130.176.6
38.130.176.66
38.130.176.76
38.130.176.81
38.130.176.9
38.130.176.91
38.130.178.111
38.130.178.126
38.130.178.141
38.130.178.156
38.130.178.96
38.130.180.124
38.130.180.24
38.130.180.45
38.130.180.54
38.130.180.60
38.130.180.69
38.130.180.84
38.130.180.9
38.131.171.10
38.131.171.138
38.131.171.234
38.132.200.30
38.132.200.62
38.132.200.94
38.133.120.10
38.133.120.106
38.133.120.138
38.133.120.170
38.133.120.202
38.133.120.234
38.133.120.42
38.133.120.74
38.64.101.114
38.64.101.146
38.64.101.18
38.64.101.50
38.64.101.82
38.64.102.14
38.64.102.46
38.64.102.78
38.64.55.128
38.64.55.145
38.64.55.192
38.64.55.224
38.64.56.14
38.64.56.46
38.64.56.78
38.83.11.108
38.83.11.12
38.83.11.140
38.83.11.172
38.83.11.204
38.83.11.236
38.83.11.44
38.83.11.76
38.83.9.116
38.83.9.148
38.83.9.180
38.83.9.20
38.83.9.212
38.83.9.244
38.83.9.52
38.83.9.84
38.86.228.31
38.86.228.46
38.86.228.78
38.86.229.20
38.86.229.244
38.86.229.46
38.86.229.52
38.86.229.84
38.90.148.110
38.90.148.14
38.90.148.142
38.90.148.174
38.90.148.206
38.90.148.238
38.90.148.46
38.90.148.78
38.94.198.14
38.94.198.206
38.94.198.238
38.95.185.2
38.95.185.5
38.97.133.124
38.97.133.13
38.97.133.220
38.97.133.237
38.97.133.252
38.97.133.28
38.97.133.60
38.97.133.92
43.226.26.99
45.32.139.17
45.32.167.223
45.32.168.121
45.32.199.75
45.32.201.132
45.32.216.70
45.32.222.244
45.32.223.213
45.32.223.29
45.32.230.12
45.5.65.222
45.5.65.254
45.5.65.30
45.5.66.110
45.5.66.14
45.5.66.142
45.5.66.46
45.5.66.78
45.58.32.162
45.58.40.179
45.58.45.186
45.58.46.12
45.58.46.23
45.58.47.7
45.58.48.218
45.58.48.219
45.58.49.116
45.58.49.120
45.58.49.208
45.58.49.209
45.58.49.210
45.58.49.36
45.58.49.53
45.58.52.43
45.58.55.49
45.58.55.50
45.59.116.78
45.59.119.29
45.59.121.184
45.59.121.185
45.59.121.186
45.59.126.10
45.59.126.13
45.59.126.142
45.59.126.148
45.59.126.15
45.59.126.203
45.59.126.209
45.59.126.219
45.59.126.220
45.59.126.38
45.59.126.79
45.59.126.87
45.61.105.114
45.61.105.123
45.61.105.146
45.61.105.178
45.61.105.18
45.61.105.210
45.61.105.50
45.61.105.82
45.61.111.114
45.61.111.146
45.61.111.18
45.61.111.50
45.61.111.82
45.63.109.34
45.63.11.12
45.63.19.185
45.63.34.209
45.63.68.132
45.63.68.199
45.63.77.239
45.63.78.156
45.63.91.30
45.76.169.173
45.76.169.76
45.76.170.196
45.76.69.88
45.77.213.108
45.79.1.56
45.79.113.187
45.79.13.132
45.79.168.30
45.79.176.87
45.79.198.99
45.79.206.66
45.79.213.90
45.79.226.139
45.79.69.120
45.79.76.164
45.79.92.135
46.19.143.137
5.226.169.117
5.226.169.127
5.226.169.134
5.253.87.182
5.253.87.183
5.253.87.184
5.253.87.185
50.116.58.205
50.2.81.135
50.2.81.136
50.22.186.222
64.140.140.12
64.140.140.44
64.140.140.76
64.140.142.124
64.140.142.156
64.140.142.188
64.140.142.220
64.140.142.252
64.140.142.28
64.140.142.60
64.140.142.92
64.251.15.158
64.251.21.52
65.111.180.137
65.181.112.202
65.181.113.143
65.181.113.147
65.181.113.150
65.181.122.15
65.181.122.152
65.181.122.155
65.181.125.103
65.181.127.18
66.187.76.178
66.187.76.27
66.78.16.252
66.78.16.28
66.78.16.60
66.78.17.128
66.78.17.160
66.78.17.192
66.78.17.224
66.78.17.96
66.85.139.196
66.85.185.67
66.85.185.92
66.85.186.233
66.85.186.235
68.233.46.14
68.233.46.61
68.233.46.62
69.12.74.189
69.12.74.19
69.12.74.190
69.12.93.115
69.12.93.158
69.12.93.190
69.12.93.222
69.12.93.254
69.12.93.34
69.12.93.66
69.12.93.98
69.50.232.108
69.50.232.12
69.50.232.140
69.50.232.172
69.50.232.204
69.50.232.236
69.50.232.44
69.50.232.76
69.51.13.45
69.51.16.177
69.51.21.35
69.51.21.36
69.51.25.225
69.51.25.226
69.51.25.227
69.51.6.50
69.51.6.6
69.60.98.13
69.87.218.112
72.19.15.181
72.19.15.182
74.114.118.124
74.114.118.156
74.114.118.188
74.114.118.220
74.114.118.252
74.114.118.28
74.114.118.60
74.114.118.92
74.208.159.196
74.208.169.168
75.102.38.250
75.127.10.102
75.127.10.48
75.127.10.57
75.127.10.61
75.127.10.62
76.8.60.130
76.8.60.140
76.8.60.241
76.8.60.242
85.203.48.24
85.203.48.56
85.203.48.88
85.203.49.24
85.203.49.56
85.203.49.62
85.203.49.94
85.203.50.38
85.203.50.6
85.203.50.70
85.203.51.178
85.203.51.18
85.203.51.210
85.203.51.242
85.203.51.50
96.45.163.18
96.45.163.22
96.8.113.39
96.8.120.160
96.8.120.161
98.158.179.61

[adrianTNT]

Thanks for the tips, but what do you think about that image graph ? Does it look like it affects the organic traffic ?

[imgur.com...]

[tangor]

Affect it how? What I see is bogus (non-human) data inserted into the mix which creates strange numbers in final reports.

Manage the non-human and realities will change significantly ... often making a web site look "lifeless" ...

Many from the list are "old fiends" (sic) addressed some time back, now producing 403s, which are easy to remove from the reporting side ... the remaining numbers make more sense and align with conversions in a more logical way.

Unless there is a compelling reason to NOT deny similar bad actors, just show them the exit before they get through the door. Only "you" (meaning the webmaster) can determine what works or does not work in that regard.

[not2easy]

Those who believe that their stats only count humans can find a rude awakening with some log wrestling. The old topic "Most of Your Traffic is Not Human" here: [webmasterworld.com...] is more true today than when it was first posted. I have only seen the humanoid traffic increasing.

[adrianTNT]

Affect it how? What I see is bogus (non-human) data inserted into the mix which creates strange numbers in final reports.

I mean, doesn’t it look like organic traffic decrease at the exact same time when these bots start hitting the site ?
[imgur.com...]

[tangor]

Your organic did NOT decrease, your NOISE TRAFFIC increased.

Remove the noise and then take a second look.

[adrianTNT]

I saw on some news sites that recently users received "AdSense extortion" emails, pay up $5000 in BTC or they claim will generate huge amount of invalid click activity to lock your account. Seen the news on KrebsOnSecurity, Seroundtable, etc.

I am afraid that all this bot activity might be about that, I used Google's "report invalid activity" form and mentioned these IPs too; nobody from Google bothered to answer, 12 days and counting now.

[tangor]

The extortion stuff is generally a bluff (scam) and likely the adsense crew will not bother replying.

[adrianTNT]

When I contacted them I didn't knew about this extortion emails. I notified them because I seen the huge bot activity and adsense earnings going down. Eider way, they could reply. Maybe the issue IS huge and they still look into it :)

[blend27]

-- Your organic did NOT decrease, your NOISE TRAFFIC increased. --

There should be a specific HTTP RESPONSE CODE for that, preferably none numeric.

[adrianTNT]

Honestly I don't understand what you two are telling me about the noise.
I understand you two refer to noise as bots mixed with normal users and showing wrong total users ?
The chart ( [imgur.com...] ) shows total users from search engines going down exactly when bots started visiting the site, there is no noise in that from what I understand.
Did I get it wrong ?

[tangor]

Probably not ... but the increase in noise (and overall traffic being near same) something's got to give.

On the other hand, if you proactively nuke the bots so they never get a bite THAT activity has less effect (and your site has more time) on the traffic that DOES get to you.

I personally don't like bots not just for the potential scam, scrap, and other non-productive activities, but simply because I get ZERO value from them. That's why I usually start with a white list and go from there ... blacklisting is a never ending battle.

YMMV

[adrianTNT]

Yes, they always find ways around it, but I blocked most of them.
Until I will find new ways to identify them and then I will notice they were on the site for a while already :) That is how it usually works.

[blend27]

@adrianTNT

just a suggestion: log headers, write a routine that does that, i mean full headers. Write a filter or 2 or 3. Turn it on then off then on, see what happens. Logs is what makes 'them' silly, put some TNT into it.

When someone honks a horn outside of the house for no particular reason(at 5 am) it does not make them a Spy.

[adrianTNT]

I did started logging full headers for hits on a bot trap page.
Bot traps are effective, you have less IPs to look at :)

[blend27]

you have less IPs to look at :)

if only that was true (:

[blend27]

The backend technology u use(.net/php/coldfusion) to serve the content to include/overwrite/rule something that really is not css/gif/js but looks like it is by the path.

Send a header that looks like it, catch the -...

Turn it on, tun it off.