flipboard

[Pfui]

Twitter swarmer:

ec2-174-129-104-82.compute-1.amazonaws.com
Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2) Gecko/20100115 Firefox/3.6 (+http://flipboard.com/crawler)

robots.txt? NO

HEAD then GET to same html doc; 2 hits in 2 secs.

See also: amazonaws.com plays host to wide variety of bad bots [webmasterworld.com...]

[Pfui]

Kinda tricky "following the robots.txt rules" (info page) if you never ask for it...

ec2-174-129-104-82.compute-1.amazonaws.com
Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2) Gecko/20100115 Firefox/3.6 (+http://flipboard.com/crawler)
09/05 20:39:57 /
09/05 20:39:57 /
09/05 20:39:59 /
09/05 20:39:59 /
09/05 20:40:10 /
09/05 20:40:11 /

ec2-174-129-125-105.compute-1.amazonaws.com
Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2) Gecko/20100115 Firefox/3.6 (+http://flipboard.com/crawler)
09/05 20:39:57 /
09/05 20:39:59 /

First Host is same as OP's. Also the same: HEADs and GETs, but this time more GETs.

[keyplyr]

That agent would get stopped in 3 of my filters.

[Pfui]

New UA:

ec2-72-44-44-132.compute-1.amazonaws.com
Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2) Gecko/20100115 Firefox/3.6 (FlipboardBrowserProxy/1.1; +http://flipboard.com/browserproxy)

robots.txt? NO