homepage Welcome to WebmasterWorld Guest from 54.205.144.54
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Visit PubCon.com
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
weird spider/bot activity?
erickoh




msg:402463
 5:49 pm on Mar 16, 2001 (gmt 0)

Hi,

I was going through my log when I saw these lines

212.87.60.78 [13:13:09] "HEAD /m.htm HTTP/1.0" 200 0 "Mozilla/3.01 ( compatible; MSIE 5.01; Windows 95; ezn IE )"
212.87.60.78 [13:13:11] "HEAD /m.htm HTTP/1.0" 200 0 "Mozilla/4.73 ( compatible; MSIE 4.01; AOL 5.0; DigiExt )"
212.87.60.78 [13:13:11] "HEAD /m.htm HTTP/1.0" 200 0 "Mozilla/4.0 ( compatible; MSIE 5.5; Windows NT4.0; DigiExt )"

repeat about 1100 times with varying user agents

212.87.60.78 [13:14:44] "HEAD /m.htm HTTP/1.0" 200 0 "Mozilla/4.72 ( compatible; [en]; Windows NT4.0; DigiExt )"

and another one (2 days later)

210.220.153.82 [21:06:24] "GET /b/index.htm HTTP/1.0" 200 11403 "Mozilla/3.0 (compatible)"
210.220.153.82 [21:06:32] "HEAD /b/index.htm HTTP/1.0" 200 0 "Mozilla/3.0 (compatible)"
210.220.153.82 [21:06:33] "HEAD /b/index.htm HTTP/1.0" 200 0 "Mozilla/3.0 (compatible)"

repeat 7720 times

210.220.153.82 [21:14:54] "HEAD /b/index.htm HTTP/1.0" 200 0 "Mozilla/3.0 (compatible)"

[rests for a minute, then...]

210.220.153.82 [21:16:08] "GET /b/index.htm HTTP/1.0" 200 11403 "Mozilla/3.0 (compatible)"
210.220.153.82 [21:16:13] "HEAD /b/index.htm HTTP/1.0" 200 0 "Mozilla/4.0 (compatible; MSIE 5.0; Win32)"
210.220.153.82 [21:16:13] "HEAD /b/index.htm HTTP/1.0" 200 0 "Mozilla/4.0 (compatible; MSIE 5.0; Win32)"

repeat 11390 times

210.220.153.82 [21:27:57] "HEAD /b/index.htm HTTP/1.0" 200 0 "Mozilla/4.0 (compatible; MSIE 5.0; Win32)"

I'm a newbie webmaster, so I'm not sure what to do or feel about this. Could it just be a bot with faulty algorithm?
Does this kind of thing happen all the time and should I take some action?

Thanks in advance!

 

oilman




msg:402464
 6:08 pm on Mar 16, 2001 (gmt 0)

Hi erickoh - welcome to WebmasterWorld.

That IP is part of the Korea Network Information Center. Their whois is here: [whois.nic.or.kr...] - I don't know Korean and I didn't have my Windows disc to install the language pack so that's where the trail ended for me ;)

tcmalaska




msg:402465
 8:40 pm on Mar 16, 2001 (gmt 0)

# ENGLISH

IP Address : 210.220.144.0-210.220.159.255
Connect ISP Name : KOLNET
Connect Date : 20000113
Registration Date : 19990911
Network Name : HITEL-NET

[ Organization Information ]
Orgnization ID : ORG154836
Name : Korea Telecom Hitel
State : SEOUL
Address : SamsungOmniTower 395-62 Shindaebang-Dong Dongjac-Ku
Zip Code : 156-010

[ Admin Contact Information]
Name : Wonbong Song
Org Name : Korea Telecom Hitel
State : SEOUL
Address : Samsung Omni Tower 395-62 Shindaebang-Dong Dongjac-Ku
Zip Code : 156-010
Phone : +82-2-3289-2481
Fax : +82-2-3289-2080
E-Mail : mgr@mail.hitel.net

[ Technical Contact Information ]
Name : Wonbong Song
Org Name : Korea Telecom Hitel
Address : Samsung Omni Tower 395-62 Shindaebang-Dong Dongjac-Ku
Zip Code : 156-010
Phone : +82-2-3289-2481
Fax : +82-2-3289-2080
E-Mail : mgr@mail.hitel.net

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved