Welcome to WebmasterWorld Guest from 54.162.155.183

Forum Moderators: Ocean10000 & incrediBILL

Message Too Old, No Replies

Anyone ever determine what TechTargetCrawl is?

     
9:50 am on Mar 19, 2001 (gmt 0)

WebmasterWorld Administrator brett_tabke is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



Ever seen it? Wonder what it's purpose is...
y1702.inktomi.com¦216.35.119.48¦Slurp/2.0-TechTargetCrawl (slurp@inktomi.com; [inktomi.com...]
10:33 pm on Mar 19, 2001 (gmt 0)



Just a hunch but maybe this [techtarget.com] has something to do with it.
10:36 pm on Mar 19, 2001 (gmt 0)

WebmasterWorld Senior Member mivox is a WebmasterWorld Top Contributor of All Time 10+ Year Member



Wasn't it inktomi who told someone else that they had many different inktomi spiders working on client-specific indexing projects?

Apparently, they not only maintain and farm out their own 'whole-web' databases, but will create and manitain custom databases for clients. Perhaps TechTarget is one of Ink's back-end indexing clients?

 

Featured Threads

Hot Threads This Week

Hot Threads This Month