They've been making the rounds laity. [webmasterworld.com...] This is one of the post that talks about it. I think there are two others. If you plug in their IP it will throw you to a splash page that talks about the server farm in Fremont. I know they are crawling from two separate IPs. At first I thought they might be doing some clever marketing by causing a buz with their crawling. But I really don't know what they are up to yet.
8:20 pm on Apr 28, 2001 (gmt 0)
9:39 pm on Apr 29, 2001 (gmt 0)
Any ideas if it's worth blocking this IP...is there a good way of banning them *as if there is a good way of banning, but hey* Thanks for all the help ;)
9:48 pm on Apr 29, 2001 (gmt 0)
If you are using a *nix system you can use the .htaccess file to ban them and it will work unless they start coming from a different IP.
11:13 pm on Apr 29, 2001 (gmt 0)
I contacted the huuricane electric abuse department. After they deep crawled my site super fast 3 times. Here was there response: Thank you for your feedback/interest. analysis.he.net is an experimental web indexing tool. We take a number of precautions to ensure that the load we cause your web server is minimized such as only accessing one URL at your domain name at a time. We appologize for any confusion we may have caused. And here is the email address of the guy who responded: Scott Nelson <firstname.lastname@example.org>
1:33 am on Apr 30, 2001 (gmt 0)
The email was a big [url=www.he.net/~scottn/]help[/url]. Finally something to work with...