111.0.0.0 - 111.63.255.255 China Mobile Communications Corporation
There's no rDNS identifying that it's a Baidu crawler range.
dstiles
9:42 pm on Oct 25, 2011 (gmt 0)
Wouldn't have thought so. I have had several google impersonators recently - perhaps this is the chinese equivalent?
Just carried out a spot check on a dozen or so IPs in the range 111.1.0.0/18 and found quite a few open ports in the range 111.1.3.0 - 111.1.36.255, possibly more. Good enough to block, anyway. I've just blocked the range 111.1.0.0 - 111.1.47.255 which hopefully will cover them all.
For me, most of the bigger hitters were on 111.1.32/24, which has lots of IPs with open ports but nothing in robtex suggesting it's legit.
Spamhaus does not show the range as dynamic (a lot of china isn't submitted) and blacklistalert.org does not show anything really bad about the range.
keyplyr
12:42 am on Oct 26, 2011 (gmt 0)
I allow Baiduspider from ranges that rDNS as Baidu crawler, but from recent experience APNIC/Asian ranges can be slow to add this info (or the info is slow to propagate) for newly added ranges.
Example: just saw Baidu added crawler rDNS to 123.125.71.0 - 123.125.71.255 a couple days ago. I had been blocking it, now allowed.
Baiduspider from the mobile range is likely just a spoof and was blocked, but just making sure :)
dstiles
9:23 pm on Oct 26, 2011 (gmt 0)
Baidu isn't alone in this - see postings in this topic re: MS.
Thanks for the IPs. I already have those blocked as "bot but kill" (it's chinese and I ban those bots) but I check the IPs posted here and add new ones from time to time. :)
keyplyr
12:38 am on Oct 27, 2011 (gmt 0)
My opinion is - just because it's Chinese I don't block it. Yes, in the last several years an increasing amount of trouble has been coming from APNIC/Asian ranges.
Now we all know that [some] Chinese like to rip-off products & other things of value and present them as their own (the bogus Apple store in Bejing) so I feel it's important to represent my branding there as a defensive measure.
If the "real thing" is not represented in the Asian SERP, then who's to contest what's authentic or not.
Anyway, thanks dstiles for doing the research on the ranges.
dstiles
9:28 pm on Oct 27, 2011 (gmt 0)
I nor my clients sell into China. Apart from that I am not enamoured of the regime, although I recognise this is not something the average Chinese can affect over-much.
I know my sites are in chinese SEs, often culled from other SEs (eg we allow baidu Japan). I have a block on SOME web sites against not only Chinese dynamic IP ranges but in some cases many other countries. Mostly my clients are operating within the UK, often with a county or even a town, so in some cases world-wide is not relevant.
