Forum Moderators: open

Message Too Old, No Replies

Polytechnic University - Brooklyn

Scrape attemps from var IPs

         

blend27

12:18 pm on Apr 24, 2016 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Just FYI,

Started on about 01/31/16. A plethora of fake UAs, bad headers, all for the root URL.

No request for robots.txt.

128.238.182.61 gray01.poly.edu 2016-04-23 17:03:00.530 Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.135 Safari/537.36
128.238.182.61 gray01.poly.edu 2016-04-23 14:39:13.683 Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.135 Safari/537.36
128.238.182.61 gray01.poly.edu 2016-04-23 12:00:15.220 Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.135 Safari/537.36
128.238.182.61 gray01.poly.edu 2016-04-23 08:08:03.950 Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.135 Safari/537.36
128.238.182.61 gray01.poly.edu 2016-04-21 09:48:51.657 Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.135 Safari/537.36
128.238.182.66 gray06.poly.edu 2016-02-23 00:58:26.577 python-requests/2.9.1
128.238.182.65 gray05.poly.edu 2016-02-23 00:58:26.573 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
128.238.182.63 gray03.poly.edu 2016-02-23 00:58:26.460 Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.135 Safari/537.36
128.238.182.62 gray02.poly.edu 2016-02-23 00:58:25.973 Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)
128.238.182.61 gray01.poly.edu 2016-02-23 00:58:25.870 ACHE
128.238.182.75 gray15.poly.edu 2016-02-07 06:47:28.793 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
128.238.182.73 gray13.poly.edu 2016-02-07 06:47:26.400 Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.135 Safari/537.36
128.238.182.72 gray12.poly.edu 2016-02-07 06:47:26.397 Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)
128.238.182.77 gray17.poly.edu 2016-02-07 06:47:26.393 python-requests/2.5.1 CPython/2.6.6 Linux/2.6.32-504.23.4.el6.x86_64
128.238.182.71 gray11.poly.edu 2016-02-07 06:47:26.393 ACHE
128.238.182.75 gray15.poly.edu 2016-02-01 17:59:25.253 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
128.238.182.71 gray11.poly.edu 2016-01-31 17:57:09.687 ACHE
128.238.182.77 gray17.poly.edu 2016-01-31 17:57:09.547 python-requests/2.5.1 CPython/2.6.6 Linux/2.6.32-504.23.4.el6.x86_64
128.238.182.75 gray15.poly.edu 2016-01-31 17:57:09.540 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
128.238.182.73 gray13.poly.edu 2016-01-31 17:57:09.413 Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.135 Safari/537.36
128.238.182.72 gray12.poly.edu 2016-01-31 17:57:08.867 Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)

keyplyr

12:56 pm on Apr 24, 2016 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Looks like one node cluster so likely an infected machine. Suggest you send an abuse report to the admins there (including access log snippets, your site's IP address and domain name.)

I have dealings with them and IMO they are an ethical company run by responsible admins.

blend27

2:20 pm on Apr 24, 2016 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



I'll compile a more detailed list and send it out to the admins there.

OT
Amazing indexing speed by Goog And Bing, I just searched for 128.238.182.71 and this thread comes right up.