Welcome to WebmasterWorld Guest from 54.162.227.136

Forum Moderators: Ocean10000 & incrediBILL

Message Too Old, No Replies

Spiders

He.net, anybody know who he is.

     
3:28 pm on Apr 26, 2001 (gmt 0)

10+ Year Member



Hello,

He.net or analysis.he.net has been to several of my sites doing deep crawls. Any one know who it is?

Thanks

4:37 pm on Apr 26, 2001 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Been seen before, no definitive answers:

[webmasterworld.com...]

5:05 pm on Apr 26, 2001 (gmt 0)

WebmasterWorld Senior Member littleman is a WebmasterWorld Top Contributor of All Time 10+ Year Member



They've been making the rounds laity.
[webmasterworld.com...]
This is one of the post that talks about it. I think there are two others. If you plug in their IP it will throw you to a splash page that talks about the server farm in Fremont. I know they are crawling from two separate IPs. At first I thought they might be doing some clever marketing by causing a buz with their crawling. But I really don't know what they are up to yet.
8:20 pm on Apr 28, 2001 (gmt 0)

10+ Year Member



Its hammering one of my sites, doing faulty requests for fragments of javascript and generally annoying me :(
Strange thing is it has a UA of Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0).
I am very tempted to ban them.
9:39 pm on Apr 29, 2001 (gmt 0)

10+ Year Member



Any ideas if it's worth blocking this IP...is there a good way of banning them *as if there is a good way of banning, but hey* Thanks for all the help ;)
9:48 pm on Apr 29, 2001 (gmt 0)

10+ Year Member



If you are using a *nix system you can use the .htaccess file to ban them and it will work unless they start coming from a different IP.
11:13 pm on Apr 29, 2001 (gmt 0)

10+ Year Member



I contacted the huuricane electric abuse department. After they deep crawled my site super fast 3 times. Here was there response: Thank you for your feedback/interest. analysis.he.net is an experimental
web indexing tool. We take a number of precautions to ensure that the
load we cause your web server is minimized such as only accessing one URL
at your domain name at a time. We appologize for any confusion we may
have caused.
And here is the email address of the guy who responded: Scott Nelson <scottn@he.net>
1:33 am on Apr 30, 2001 (gmt 0)



The email was a big [url=www.he.net/~scottn/]help[/url]. Finally something to work with...
 

Featured Threads

Hot Threads This Week

Hot Threads This Month