Edacious & Intelligent Web Crawler

[volatilegx]

UA: "EDI/1.4.1 (Edacious & Intelligent Web Crawler)"

Does anybody know what this is used for?

[GaryK]

I'm not sure Dan. But Edacious means: devouring; voracious; consuming. None of which sound good when we're talking about bots even when you combine it with Intelligent. :)

How badly did it hit your sites?

[abates]

It's been prodding my site too. Only fetched one page so far (refetching it daily), but it tried to fetch /subdirectory/robots.txt, so it's obviously not that intelligent...

The IP address it comes from is in APNIC's range, who say it's assigned to Korea.

[keyplyr]

UA: "EDI/1.4.1 (Edacious & Intelligent Web Crawler)"

Does anybody know what this is used for?

Edacious & intelligent web crawling?

[volatilegx]

> How badly did it hit your sites?

Nothing out of the ordinary. I've just been seeing it for awhile now and I want to know what it is for.

[GaryK]

The only thing I've been able to find that was even remotely useful was from one of Bill's blog posts back on August 11th. It's crawling from several IP Addresses in Korea and its IP range is next to a known naught bot named Yeti. I'm not sure if it's ok to post the URL to Bill's blog. Google "Edacious & Intelligent" (with quotes) and it's in the top five results.

[netchicken1]

"edacious" what a good word. "Microsoft is an edacious organization.

[GaryK]

Apparently they are racing through the versions because one of my sites was visited by 1.4.0 and 1.6.0 from Korea this past week.

EDI/1.4.1 (Edacious & Intelligent Web Crawler)
222.231.50.*

EDI/1.6.0 (Edacious & Intelligent Web Crawler)
222.231.42.*

It read robots.txt and respected it. It took pages at a reasonable rate.

Unfortunately we're still no closer to knowing what it's for than when Dan first asked his question.

[volatilegx]

OK, here's some tasty info about this crawler...

The latest UA for this one is:

EDI/1.6.5 (Edacious & Intelligent Web Robot, Daum Communications Corp.)

Check out Daum Communications Corp. [biz.yahoo.com]

International expansion is on the agenda for Daum Communications, with the 2004 purchase of Lycos, the US business of Spain's Terra Networks, for $105 million.

[GaryK]

Good eye Dan. I wonder why they added the corporate name to the user agent but not a link?

[volatilegx]

I don't know, Gary, but I'm not adding this one to my Lycos list until I hear something more definitive.

[GaryK]

Here is a link to their website. Sadly I cannot read it.
[daum.net...]

Two visits from them this past week:

EDI/1.6.6 (Edacious & Intelligent Web Robot, Daum Communications Corp.)
222.231.42.**

EDI/1.6.5 (Edacious & Intelligent Web Robot, Daum Communications Corp.)
211.115.109.***

I tried using x's to denote the D block but WebmasterWorld's wonky word filter turned it into a cartoonish-type curse word.

[edited by: GaryK at 8:01 pm (utc) on Oct. 15, 2006]