Forum Moderators: open

Message Too Old, No Replies

FlipboardProxy

At least 2 versions; 2 cases (2 much)

         

Pfui

5:50 pm on Aug 30, 2011 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Still bot-running from amazonaws, simultaneously using multiple UAs with different versions and upper/lowercases within seconds of each other.

Strings (all four appended to Mac Firefox/3.6):

(FlipboardProxy/0.0.5; +http://flipboard.com/browserproxy)
(FlipboardProxy/1.1; +http://flipboard.com/browserproxy)
(flipboardBrowserProxy/1.1; +http://flipboard.com/browserproxy)
(+http://flipboard.com/crawler)

Details:

Asks for robots.txt some of the time BUT ignores it ALL of the time.

Aug., 2011 -

ec2-50-17-34-27.compute-1.amazonaws.com
Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2) Gecko/20100115 Firefox/3.6 (FlipboardProxy/0.0.5; +http://flipboard.com/browserproxy)

ec2-184-73-58-71.compute-1.amazonaws.com
Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2) Gecko/20100115 Firefox/3.6 (FlipboardProxy/1.1; +http://flipboard.com/browserproxy)

Aug.-Sep., 2010

ec2-72-44-44-132.compute-1.amazonaws.com
Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2) Gecko/20100115 Firefox/3.6 (flipboardBrowserProxy/1.1; +http://flipboard.com/browserproxy)

ec2-174-129-125-105.compute-1.amazonaws.com
Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2) Gecko/20100115 Firefox/3.6 (+http://flipboard.com/crawler)

Previously:

flipboard [webmasterworld.com...]
amazonaws.com plays host to wide variety of bad bots [webmasterworld.com...]

keyplyr

7:59 pm on Aug 30, 2011 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Hits my sites everyday despite consistent 403s, same IP ranges.

Pfui

12:20 pm on Sep 27, 2011 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Flipboard's proxy is still abusive. This time, hitting with just one version of its UA --

Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2) Gecko/20100115 Firefox/3.6 (FlipboardProxy/1.1; +http://flipboard.com/browserproxy)

-- via three AWS zombies, still greedily ignoring a full Disallow in the robots.txt it reads and never, ever heeds:

ec2-107-20-90-45.compute-1.amazonaws.com
nn:52:45 /robots.txt (200)
nn:52:47 /file (403)

ec2-184-72-174-233.compute-1.amazonaws.com
nn:52:39 /robots.txt (200)
nn:52:44 /file (403)
nn:52:44 /file (403)

ec2-107-20-104-53.compute-1.amazonaws.com
nn:52:34 /robots.txt (200)
nn:52:38 /file (403)
nn:52:38 /file (403)
nn:52:38 /file (403)
nn:52:38 / (403)
nn:52:39 /file (403)
nn:52:39 /file (403)
nn:52:49 / (403)
nn:58:42 /robots.txt (200)

Like keyplyr, Flipboard's proxy -- which looks to be advance-mining, not just click-reacting -- hits all day, every day, regardless of denials.

##