Forum Moderators: open

Message Too Old, No Replies

CligooRobot/1.0

         

keyplyr

8:08 am on Nov 29, 2009 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



IP address: 62.89.187.***
No reverse DNS entry per rns.bcc-ip.net
BCC10-RIPE Braunschweig, Germany
robots.txt: yes

GaryK

6:26 pm on Nov 29, 2009 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I just saw this one too. All the same details that you posted, keyplyr.

dstiles

10:46 pm on Nov 29, 2009 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



The only hit I've got this month in that IP range had no UA at all.

I've been getting BCC/1.0 from 195.188.208.nnn which is a UK local authority range of a city for which I have relevant sites, so probably trawling for local sites. I think the two UAs are coincidental.

Pfui

8:34 am on Dec 4, 2009 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Be on the lookout for a same-IP tag team hitting with the bot UA, and with no UA. Both times asked for, but ignored, robots.txt. Both also made a beeline to sitemap.xml (which is blocked six ways to Sunday to other than select majors).

-----
62.89.187.nnn
-

11/21 21:59:58 /sitemap.xml
11/21 21:59:58 /robots.txt
11/21 21:59:59

-----
62.89.187.nnn
CligooRobot/1.0

11/28 22:18:20 /robots.txt
11/28 22:18:22 /sitemap.xml
11/28 22:18:23

P.S.
A Google search on the IP shows it listed on one Security News site as a "Site Scraper."

Pfui

6:57 pm on Jan 11, 2010 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



62.89.187.21*
CligooRobot/1.0

robots.txt? Yes BUT promptly ignored it. Again.