How rouge can this scraper get?
Headers:
ip: 218.28.172.XXX
remote host: 218.28.172.XXX (-7)
time: {ts '2016-04-04 nn:nn:nn'}
method: HEAD
protocol: HTTP/1.0
headers list: X-REQUEST-URI,host,user-agent,Via,connection,content-length,X-REWRITE-URL,referer,Cache-Control,X-Forwarded-For
X-REQUEST-URI: /
host: exampledomain.tld
user-agent: Mozilla/5.0 (Linux; <Android Version>; <Build Tag etc.>) AppleWebKit/<WebKit Rev> (KHTML, like Gecko) Chrome/<Chrome Rev> Mobile Safari/<WebKit Rev>
Via: 1.1 WIN-RC7LNLPQ3D2:3128 (SWProxy/1.0.0.3)
connection: keep-alive
content-length: 0
X-REWRITE-URL: /
referer: exampledomain.tld
Cache-Control: max-age=259200
X-Forwarded-For: 5.189.190.XXX
That is the actual UA without balding of the text.
Bot is asking me to pull a Klondike bar out of my pocket after traveling a week thru Kalahari Desert.
