CAP LOCKs Robot from China - Crawler, Spider, and User Agent ID forum at WebmasterWorld - WebmasterWorld

Forum Moderators: open

Message Too Old, No Replies

CAP LOCKs Robot from China

Internet Explore 5.x

misosoph

5:45 am on Jun 11, 2002 (gmt 0)

10+ Year Member

211.157.101.42 - - [10/Jun/2002:11:26:39 -0700] "GET / HTTP/1.1" 200 7682 "-" "Internet Explore 5.x"
211.157.101.42 - - [10/Jun/2002:11:26:46 -0700] "GET /SEARCH.HTML HTTP/1.1" 404 290 "-" "Internet Explore 5.x"
0700] "GET /UPDATES.HTML HTTP/1.1" 404 291 "-" "Internet Explore 5.x"
211.157.101.42 - - [10/Jun/2002:11:26:46 -0700] "GET /SITEMAP.HTML HTTP/1.1" 404 291 "-" "Internet Explore 5.x"
211.157.101.42 - - [10/Jun/2002:11:26:46 -0700] "GET /MOLISE/GILDONE.HTML HTTP/1.1" 404 298 "-" "Internet Explore 5.x"
211.157.101.42 - - [10/Jun/2002:11:26:46 -0700] "GET /MOLISE/PIETRA.HTML HTTP/1.1" 404 297 "-" "Internet Explore 5.x"

ETC. FOR EVERY LINK ON MY HOME PAGE. Nothing but 404s, because the robot has changed all my file names to uppercase.

211.157.101.42 is registered to china communications system co.,ltd., beijing,china [Yes, all lowercase.]

Is there any reason to block a robot that blocks itself? (Maybe I should also ask: is there any way to block such a robot?)

[edited by: misosoph at 6:00 am (utc) on June 11, 2002]

littleman

5:59 am on Jun 11, 2002 (gmt 0)

I guess not. The bot-script was probably developed in a windows only environment.

misosoph

6:07 am on Jun 11, 2002 (gmt 0)

10+ Year Member

I see. Thank you. My site's host is currently running Solaris 8 on Apache/1.3.23 (Unix)....

jdMorgan

2:34 am on Jun 12, 2002 (gmt 0)

WebmasterWorld Senior Member

10+ Year Member

I've got "Internet Explore" blocked because it DID come in at one time with correct filename case, so don't ignore it.

My notes say that I decided it was an e-mail harvester.

Jim

bull

9:04 pm on Jun 15, 2002 (gmt 0)

10+ Year Member

was here too. but not only uppercase, it seems to learn:

211.157.101.42 - - [15/Jun/2002:22:04:33 +0200] "GET /INDEXD.HTML HTTP/1.1" 301 247 www.mypage.net "-" "Internet Explore 5.x" "-"
211.157.101.42 - - [15/Jun/2002:22:04:33 +0200] "GET /INDEXE.HTML HTTP/1.1" 301 247 www.mypage.net "-" "Internet Explore 5.x" "-"
211.157.101.42 - - [15/Jun/2002:22:04:33 +0200] "GET /indexe.html HTTP/1.1" 200 2731 www.mypage.net "-" "Internet Explore 5.x" "-"
211.157.101.42 - - [15/Jun/2002:22:04:33 +0200] "GET /indexd.html HTTP/1.1" 200 2800 www.mypage.net "-" "Internet Explore 5.x" "-"
211.157.101.42 - - [15/Jun/2002:22:05:26 +0200] "GET /STARTE.HTML HTTP/1.1" 301 247 www.mypage.net "-" "Internet Explore 5.x" "-"
211.157.101.42 - - [15/Jun/2002:22:05:26 +0200] "GET /START.HTML HTTP/1.1" 301 246 www.mypage.net "-" "Internet Explore 5.x" "-"
211.157.101.42 - - [15/Jun/2002:22:05:26 +0200] "GET /starte.html HTTP/1.1" 200 615 www.mypage.net "-" "Internet Explore 5.x" "-"
211.157.101.42 - - [15/Jun/2002:22:05:26 +0200] "GET /start.html HTTP/1.1" 200 617 www.mypage.net "-" "Internet Explore 5.x" "-"

tries upper and lowercase the same time. blocked the whole 211.157., which are all from china (don't really need users from there). the 211.157.101.42 (no rDNS) itself is from
CHINACOM
china communications system co.,ltd.
(211.157.96.0 - 211.157.127.255)