homepage Welcome to WebmasterWorld Guest from 50.19.169.37
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
Anyone ever determine what TechTargetCrawl is?
Brett_Tabke




msg:405981
 9:50 am on Mar 19, 2001 (gmt 0)

Ever seen it? Wonder what it's purpose is...
y1702.inktomi.com¦216.35.119.48¦Slurp/2.0-TechTargetCrawl (slurp@inktomi.com; [inktomi.com...]

 

Froggyman




msg:405982
 10:33 pm on Mar 19, 2001 (gmt 0)

Just a hunch but maybe this [techtarget.com] has something to do with it.

mivox




msg:405983
 10:36 pm on Mar 19, 2001 (gmt 0)

Wasn't it inktomi who told someone else that they had many different inktomi spiders working on client-specific indexing projects?

Apparently, they not only maintain and farm out their own 'whole-web' databases, but will create and manitain custom databases for clients. Perhaps TechTarget is one of Ink's back-end indexing clients?

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved