UA: Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:49.0) Gecko/20100101 Firefox/49.0 / GnowitNewsbot / Contact information at http://www.gnowit.com
UA: Mozilla/5.0 (iPad; CPU OS 10_3_2 like Mac OS X) AppleWebKit/603.2.4 (KHTML, like Gecko) Version/10.0 Mobile/14F89 Safari/602.1
Protocol: HTTP/1.1
Robots.txt: No
Host: digitalocean.com
138.197.0.0 - 138.197.255.255
138.197.0.0/16
news aggregator
So we have a log spammer, looking for content to scrape, switching UAs to pretend they are human, ignoring robots.txt, with no assigned crawl range, coming from a server farm.
Do they look trustworthy?