| Welcome to WebmasterWorld Guest from 22.214.171.124 |
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
|Become a Pro Member|
|Edacious & Intelligent Web Robot, Part 2|
| 5:30 pm on Nov 12, 2006 (gmt 0)|
The previous thead [webmasterworld.com] on this user agent is locked to new replies.
It's returned with a wacky new user agent:
Mozilla/4.0 (compatible; MSIE is not me; EDI/1.6.6; Edacious & Intelligent Web Robot; Daum Communications Corp., Korea)
| 6:50 am on Nov 13, 2006 (gmt 0)|
Yes, took 2 dozen pages - same new UA.
| 3:17 am on Nov 14, 2006 (gmt 0)|
Atleast they've fixed the robots.txt bug I noticed last time, though they're still requesting robots.txt for every page they're downloading (they could at least implement If-Modified-Since for it...)
All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved