scrapy-redis

[jonasjacek]

UA: scrapy-redis (+https://github.com/rolando/scrapy-redis)
Protocol: HTTP/1.1
Robots.txt: No
Host: Google Inc. (GOOGLE-CLOUD)
Country: US
NetRange: 104.196.0.0 - 104.199.255.255
CIDR: 104.196.0.0/14

According to GitHub page, this is a distributed crawler/scraper. "Best suitable for broad multi-domain crawls."

[keyplyr]

There's another bot "scrapy" I've had blocked by UA for years. That rule takes care of this bot also.