Forum Moderators: DixonJones

Message Too Old, No Replies

minibot(NaverRobot)/1.0

site slurper? spider? or what?

         

berli

9:30 pm on Aug 16, 2003 (gmt 0)

10+ Year Member



I got 66 requests for seperate files in 39 seconds starting with:

218.145.25.16 - - [24/Jul/2003:12:02:15 -0400] "GET /robots.txt HTTP/1.0" 200 1145 "-" "minibot(NaverRobot)/1.0"
218.145.25.16 - - [24/Jul/2003:12:02:15 -0400] "GET / HTTP/1.0" 200 1880 "-" "minibot(NaverRobot)/1.0"

What the **** is this? I searched on webmaster world and found nothing.

It did not obey robots.txt, despite downloading it.

fiestagirl

12:06 am on Aug 17, 2003 (gmt 0)

10+ Year Member



Been mentioned a few times. forum 11 is a good place to start if you are spider hunting.

[webmasterworld.com...]
[webmasterworld.com...]