Forum Moderators: open

Message Too Old, No Replies

aria2

         

TorontoBoy

8:02 pm on Aug 4, 2018 (gmt 0)

5+ Year Member Top Contributors Of The Month



UA: aria2/1.30.0 and aria2/1.33.1
Protocol: HTTP/1.1
Robots.txt: No
Host: GOOGLE-CLOUD
35.208.0.0 - 35.247.255.255 35.232.210.*
CIDR: 35.224.0.0/12, 35.240.0.0/13, 35.208.0.0/12
222.152.0.0 - 222.155.255.255 222.154.245.*
netname: SPARK NZ
descr: SPARK NEW ZEALAND TRADING LIMITED

aria2 is a lightweight multi-protocol & multi-source command-line download utility. It supports HTTP/HTTPS, FTP, SFTP, BitTorrent and Metalink. aria2 can be manipulated via built-in JSON-RPC and XML-RPC interfaces.
Reference: Linux Debian 9 Stretch Package for a High speed download utility aria2 (1.30.0-2)
https://packages.debian.org/source/stable/net/aria2

Straight download of two of my images and nothing else.

35.232.210.* [31/Jul/2018:10:33:08 GET /example/wp-content/uploads/2009/09/dsc01486-2.jpg HTTP/1.1 200 267172 - aria2/1.30.0
222.154.245.18* [04/Aug/2018:09:08:17 GET /example/wp-content/uploads/2009/09/dsc01486-2.jpg HTTP/1.1 200267172 - aria2/1.33.1

[edited by: keyplyr at 12:02 am (utc) on Aug 5, 2018]
[edit reason] delinked URLs [/edit]

lucy24

8:55 pm on Aug 4, 2018 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Oh, my. I don't pay much attention to image requests, but looking it up now (I always check logs for agents mentioned in this subforum) I find a flurry of requests spanning a week or so back in February-March, all for a few of the images associated with one specific page. All of them came from from aria2/1.33.1 living at 128.30.195

:: detour to lookup because that sounds naggingly familiar ::

Oh, I see. 128.30/15 is MIT--including the w3 validators at 128.30.52--so no wonder it seemed familiar.

keyplyr

10:20 am on Aug 5, 2018 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



I block all googleusercontent.com (Google Cloud) ranges with prejudice (allowing some UAs through)

That UA list changes periodically, but there are about 8 I find beneficial at the moment. They include the covert image retriever G+ uses, the bot that verifies Google My Business, a couple apps and several marketing bots.

Otherwise, these ranges are akin to AWS and anyone can use them for any reason, often without accountability, so the easiest way for me to deal with them is to filter who gets through.