NaverRobot/1.0 Seems Polite but Weird

[carfac]

Just found this, too:

218.145.63.155 - - [07/Sep/2002:01:06:48 -0600] "GET /robots.txt HTTP/1.0" 200 605 "-" "dloader(NaverRobot)/1.0"

Then, the same IP with a different UA appears:

218.145.63.155 - - [07/Sep/2002:02:53:17 -0600] "GET /images/buton.gif HTTP/1.0" 200 944 "http://www.xxxx.com/" "Mozilla/4.0 (compatible; MSIE 5.0; Windows 98; DigExt)"
218.145.63.155 - - [07/Sep/2002:03:11:25 -0600] "GET /xxx1.gif HTTP/1.0" 200 23147 "http://www.xxx/xxx/xxx/index.html" "Mozilla/4.0 (compatible; MSIE 6.0; Windows 98)"
218.145.63.155 - - [07/Sep/2002:05:33:05 -0600] "GET /cgi/menu_m.js HTTP/1.0" 200 1940 "http://www.xxxxxx.com/" "Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0)"

And it does that for a few pages, nibbling slowly for an hour...

Then it comes back 30 minutes later for a big chomp, with a NEW UA: "Mozilla/3.01 (compatible;)"

But all the same IP...

dave

[edited by: carfac at 4:23 pm (utc) on Sep. 7, 2002]

[PsychoTekk]

"Mozilla/3.01 (compatible;)" is often used by proxies to hide the actual UA

[Jaf]

I think this - and also dumrobo(NaverRobot) - are the robots
for www.naver.com, a Korean search engine/portal.

As such nibbling a few pages at a time is probably normal (good)
behaviour. Bit odd it should be reading JavaScript though