homepage Welcome to WebmasterWorld Guest from 54.234.42.16
register, login, search, subscribe, help, library, PubCon, announcements, recent posts, open posts,
Pubcon Website
Visit PubCon.com
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library : Charter : Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
RPT-HTTPClient / Meaningful Machines
rampaging crawler
drbrain




msg:395715		 6:36 pm on May 29, 2005 (gmt 0)

Came from 64.94.163.146 and .147.

Whois maps to:

Meaningful Machines INAP-NYM-MEANMACHINE-0652 (NET-64-94-163-128-1)
64.94.163.128 - 64.94.163.159

Never requested robots.txt

60k requests in an hour, about 17/sec.

Blocked it with setenvif:

[webmasterworld.com...]

(Yeah, they really were MEAN)

 

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About
WebmasterWorld ® and PubCon ® are a Registered Trademarks of Pubcon Inc.
© Pubcon Inc. 1996-2012 all rights reserved