Forum Moderators: open

Message Too Old, No Replies

NaverRobot masquerading as GoogleBot

I don't like it

         

Powdork

9:19 am on Aug 3, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



218.145.25.12 - - "GET /robots.txt HTTP/1.0" 404 204 "-" "GoogleBot"
218.145.25.12 - - "GET / HTTP/1.0" 200 8399 "-" "dloader(NaverRobot)/1.5"
Haven't seen this behavior before. Why bother masking as GoogleBot if you're not going to do it right?
i.e. Googlebot/2.1 (+http://www.googlebot.com/bot.html) rather than just "GoogleBot"

wilderness

11:16 am on Aug 3, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



It's been mentioned a few times recently:
[webmasterworld.com...]
[webmasterworld.com...]
[webmasterworld.com...]
[webmasterworld.com...]

fiestagirl

6:25 pm on Aug 6, 2003 (gmt 0)

10+ Year Member



FWIW. Just to add to the list of "crimes", Naver is also cacheing.

claus

12:15 am on Aug 12, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Update and confirmation:

220.73.165.77 GET "/robots.txt"HTTP/1.0

User-Agent: GoogleBot

inetnum: 220.72.0.0 - 220.87.255.255
netname: KORNET
descr: KOREA TELECOM
descr: Network Management Center
country: KR

Visited yesterday - just this one file. Just after that they switched UA to "dloader(NaverRobot)/1.5" and GOT another 71 files.

/claus

Sinner_G

7:20 am on Aug 12, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Got a visit from an adress in the same range and from the same organisation as claus.

IP: 220.73.165.140

User Agent: GoogleBot

It just looked at my robots.txt and left.

claus

3:31 pm on Aug 12, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Seems a lot like the (false) GoogleBot is just the "robots.txt" checker for NaverRobot(*) - it seems they always come in pairs. BOth seem to use HTTP/1.0 as well.

Yesterday though, GoogleBot visited again, but NaverRobot never followed.

/claus


(*) dloader(NaverRobot)/1.5