Welcome to WebmasterWorld Guest from 54.196.217.43

Forum Moderators: Ocean10000 & incrediBILL

Message Too Old, No Replies

Anyone ever determine what TechTargetCrawl is?

     
9:50 am on Mar 19, 2001 (gmt 0)

Administrator from US 

WebmasterWorld Administrator brett_tabke is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Sept 21, 1999
posts:38047
votes: 11


Ever seen it? Wonder what it's purpose is...
y1702.inktomi.com¦216.35.119.48¦Slurp/2.0-TechTargetCrawl (slurp@inktomi.com; [inktomi.com...]
10:33 pm on Mar 19, 2001 (gmt 0)

Full Member

joined:Jan 24, 2001
posts:230
votes: 0


Just a hunch but maybe this [techtarget.com] has something to do with it.
10:36 pm on Mar 19, 2001 (gmt 0)

Senior Member

WebmasterWorld Senior Member mivox is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Dec 6, 2000
posts:3928
votes: 0


Wasn't it inktomi who told someone else that they had many different inktomi spiders working on client-specific indexing projects?

Apparently, they not only maintain and farm out their own 'whole-web' databases, but will create and manitain custom databases for clients. Perhaps TechTarget is one of Ink's back-end indexing clients?