homepage Welcome to WebmasterWorld Guest from 107.22.45.61
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor
Visit PubCon.com
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
MaxPointCrawler / maxpointinteractive.com
208.123.79.68
Bewenched




msg:4516567
 10:32 pm on Nov 6, 2012 (gmt 0)

It did get robots, then in less than a second grabbed a page.

MaxPointCrawler/Nutch-1.1+(maxpoint.crawler+at+maxpointinteractive+dot+com)

 

wilderness




msg:4516621
 3:14 am on Nov 7, 2012 (gmt 0)

1) Corenap
2) Nutch

Bewenched




msg:4516687
 6:25 am on Nov 7, 2012 (gmt 0)

I'd had nutch blocked in htaccess or thought I had until I found this booger.

What is Corenap

wilderness




msg:4516796
 3:17 pm on Nov 7, 2012 (gmt 0)

a colo. just do a google and it's the first serp.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About
© Webmaster World 1996-2014 all rights reserved