Forum Moderators: open

Message Too Old, No Replies

Willow Internet Crawler

Anyone have experience of this one?

         

mack

6:14 am on Jan 3, 2003 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



Willow Internet Crawler by Twotrees V2.1

Coming from 209.184.44.99

My first thought is viral marketing?

jeremy goodrich

7:18 am on Jan 3, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



These days I get so many odds ones - I just chalk it up to something like that, or somebody doing some 'data mining' on the publically available web. :)

Unless they include some contact info, etc on their UA - or other nicety - I'd bet they are doing this - or perhaps as you said, viral marketing.

Well behaved, or bad bot?

fiestagirl

5:32 pm on Jan 3, 2003 (gmt 0)

10+ Year Member



I believe that this crawler is from a company that filters internet content for schools (K-12). You can find it with a search for the user agent on GG.