homepage Welcome to WebmasterWorld Guest from 54.161.228.29
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
MaxPointCrawler / maxpointinteractive.com
208.123.79.68
Bewenched




msg:4516567
 10:32 pm on Nov 6, 2012 (gmt 0)

It did get robots, then in less than a second grabbed a page.

MaxPointCrawler/Nutch-1.1+(maxpoint.crawler+at+maxpointinteractive+dot+com)

 

wilderness




msg:4516621
 3:14 am on Nov 7, 2012 (gmt 0)

1) Corenap
2) Nutch

Bewenched




msg:4516687
 6:25 am on Nov 7, 2012 (gmt 0)

I'd had nutch blocked in htaccess or thought I had until I found this booger.

What is Corenap

wilderness




msg:4516796
 3:17 pm on Nov 7, 2012 (gmt 0)

a colo. just do a google and it's the first serp.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved