IndustryIndexBot

[keyplyr]

UA: IndustryIndexBot/1.0 (+http://industryindex.com/bot/)
Protocol: HTTP/1.1
Robots.txt: No
Host: AWS
54.144.0.0 - 54.159.255.255
54.144.0.0/12

Marketing - 1st request was for "/" then for "ads.txt" then for "vendors.json"

Note: the URL in their UA string returns a 404 after several 301s (very poor webmastering.)

[keyplyr]

Also faking a browser...

54.84.66.** - - [29/Jun/2018:15:06:39 -0700] "GET / HTTP/1.1" 200 32130 "-" "IndustryIndexBot/1.0 (+http://industryindex.com/bot/)"

54.84.66.** - - [29/Jun/2018:15:06:40 -0700] "GET / HTTP/1.1" 403 4799 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/65.0.3325.181 Safari/537.36"

54.84.66.** - - [29/Jun/2018:15:06:41 -0700] "GET /favicon HTTP/1.1" 403 1338 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/65.0.3325.181 Safari/537.36"

I allow this marketing bot because I publish ads, but I do not allow sneaky covert behavior.