homepage Welcome to WebmasterWorld Guest from 54.227.41.242
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
Edacious & Intelligent Web Robot, Part 2
GaryK

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 3154391 posted 5:30 pm on Nov 12, 2006 (gmt 0)

The previous thead [webmasterworld.com] on this user agent is locked to new replies.

It's returned with a wacky new user agent:

Mozilla/4.0 (compatible; MSIE is not me; EDI/1.6.6; Edacious & Intelligent Web Robot; Daum Communications Corp., Korea)
211.115.109.nn
No PTR

 

keyplyr

WebmasterWorld Senior Member keyplyr us a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



 
Msg#: 3154391 posted 6:50 am on Nov 13, 2006 (gmt 0)

Yes, took 2 dozen pages - same new UA.

abates

10+ Year Member



 
Msg#: 3154391 posted 3:17 am on Nov 14, 2006 (gmt 0)

Atleast they've fixed the robots.txt bug I noticed last time, though they're still requesting robots.txt for every page they're downloading (they could at least implement If-Modified-Since for it...)

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved