Welcome to WebmasterWorld Guest from 54.226.133.245

Forum Moderators: Ocean10000 & incrediBILL

Message Too Old, No Replies

new bot?

analysis.he.net/216.218.130.79

     
4:50 pm on Feb 28, 2001 (gmt 0)

Junior Member

10+ Year Member

joined:Dec 19, 2000
posts:193
votes: 0


Comes from 216.218.130.79 (shows up as: analysis.he.net)
ua: Mozilla/4.0 (compatible;MSIE 5.5;Windows NT 5.0)

Does not seem to honor robots.txt; deep crawls;

up to 5 requests per second!!

ideas?

Skirril

4:53 pm on Feb 28, 2001 (gmt 0)

Junior Member

10+ Year Member

joined:Dec 19, 2000
posts:193
votes: 0


Forgot:

also does NOT honor robots meta tag (deep-crawled a page I had set as "noindex,nofollow")

4:52 pm on Mar 17, 2001 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Mar 10, 2001
posts:748
votes: 0


This one hit my site twice yesterday, and looking back in my logs had been around about the time you posted your message.

I do have pages that require authorization on this site. The funny thing is, it never got robots.txt, but it stays away from the directory that requires authorization. It "acts" like it has seen the robots.txt file, because it gets everything else on the site.

he.net is Hurricane Electric in Fremont, CA.

Anybody else seen this one?

4:59 pm on Mar 17, 2001 (gmt 0)

Preferred Member

10+ Year Member

joined:Nov 25, 2000
posts:541
votes: 0


I was getting ready to nuke 'em in .htaccess. I thought they were messin' with me. Sorta glad to see it's not just me.

I wonder if its one of the mods here at WmW checking up to see if we're all doing our part in applying the techniques learned here.;)

2:16 am on Apr 4, 2001 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Mar 10, 2001
posts:748
votes: 0


Well, h.e.'s back again. Nobody knows?

I just continue to let it rape my site without knowing whether to .htdisallow it or not.

Comes around about once every 2 months, just like google. Grabs everything.

4:40 pm on Apr 5, 2001 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Mar 22, 2001
posts:2450
votes: 0


I had a visit from cypress.he.net with the user agent Pizilla++ ver 2.45

Dan

digitalgirl

9:06 pm on Apr 28, 2001 (gmt 0)

Inactive Member
Account Expired

 
 


Can't one block this IP?
 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members