Forum Moderators: open

Message Too Old, No Replies

Willow Internet Crawler

twotrees.com

         

bull

8:35 pm on Jul 17, 2003 (gmt 0)

10+ Year Member



209.184.44.99 - - [17/Jul/2003:12:27:58 +0200] "GET / HTTP/1.0" 200 1491 www.-.net "-" "Willow Internet Crawler by Twotrees V2.1" "10.1.10.99" 

209.184.44.99 = db1.twotrees.com
Their menu shows things like "security solutions", "monitoring", "notification", "reporting"... dumb site with text as gif...

no robots.txt - dislike this (and their site) very much. 403.

Ally_Cat

9:03 pm on Jul 17, 2003 (gmt 0)

10+ Year Member



They filter web sites for schools - so the kiddos don't get adult content by accident. Brief look at one of the articles mentioned that schools in the US actually have to employ filtering for the students, or they lose some federal funding.