homepage Welcome to WebmasterWorld Guest from 23.20.34.25
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor
Visit PubCon.com
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
RPT-HTTPClient / Meaningful Machines
rampaging crawler
drbrain




msg:395715
 6:36 pm on May 29, 2005 (gmt 0)

Came from 64.94.163.146 and .147.

Whois maps to:

Meaningful Machines INAP-NYM-MEANMACHINE-0652 (NET-64-94-163-128-1)
64.94.163.128 - 64.94.163.159

Never requested robots.txt

60k requests in an hour, about 17/sec.

Blocked it with setenvif:

[webmasterworld.com...]

(Yeah, they really were MEAN)

 

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About
© Webmaster World 1996-2014 all rights reserved