WiseCrawler from Korea

[rtennant]

On November 18 and 19 my site was crawled by a robot calling itself "WiseCrawler". The address resolved to the Korea Internet Data Center (kidc.net). The reason I am trying to track it down is that it blew past by robots.txt file, which expressly denied access to a directory that it crawled thoroughly. Does anyone know anything about it?

[Brett_Tabke]

Welcome to the board.

Sounds like the Korean version of WiseNut [wisenut.com]? Without a ip address it is hard to be certain.

[rtennant]

I contacted WiseNut in the U.S., and they said that it wasn't their crawler (theirs is called "Zyborg"). So unless the Korean version changed the name of their crawler (and I would expect the U.S. counterparts to know), then it isn't them. But thanks for the reply.

[Will]

Got an IP address?

[wilderness]

here is a whole batch of Far East Ip's for ya
deny from 202.108.218 China use of Indy Library 08/21/01
deny from 202.108.219
deny from 202.108.220
deny from 202.108.221
deny from 202.108.222
deny from 202.108.223
deny from 203.197.74.201 CSE@IITBombay/1.0 libwww/5.3.2 09/01/01
deny from 210.116. Indy Library 210.117.67.220 10/30/01
deny from 210.117.
deny from 210.118.
deny from 210.119.
deny from 210.120.
deny from 210.121.
deny from 210.123.
deny from 210.144. Japan
deny from 210.145.
deny from 210.146.
deny from 210.147.
deny from 210.148.
deny from 210.149.
deny from 210.150.
deny from 210.151.
deny from 210.152.
deny from 210.153.
deny from 210.154.
deny from 210.155.
deny from 210.156.
deny from 210.157.
deny from 210.158.
deny from 210.159.
deny from 210.150.10. moget/2.1 ([e-mail]) 08/25/01
deny from 210.165.39.248 gazz/2.1 ([e-mail] Japan, URL invalid
deny from 210.220. KOREA TELECOM Internet Operating Center
deny from 210.221.
deny from 210.222.
deny from 210.223.
deny from 211.72. Taiwan Openfind data gatherer, Openbot/3.0+([e-mail];+http://www.openfind.com.tw/robot.html) 09/21/01
deny from 211.101. China, use of Indy Library 08/24/01 211.101.136.79
deny from 211.216. KOREA TELECOM Internet Operating Center
deny from 211.217.
deny from 211.218.
deny from 211.219.
deny from 211.220.
deny from 211.221.
deny from 211.222.
deny from 211.223.
deny from 211.224.
deny from 211.225.