Welcome to WebmasterWorld Guest from 220.127.116.11
Considering the number of 'come-from-nowhere' indexes and directories the web's seen, I plan on keeping track of this one.
"Thunderstone is an independent R&D company that has been providing high-performance state-of-the-art solutions to intelligent information retrieval and management problems for over 19 years. Our flagship product, Texis, is the most comprehensive text retrieval and publishing software available. In one package Texis provides every full-text, SQL, multimedia management, and dynamic publishing operation needed for an enterprise search application."
Doesn't sound like anyone owns them... strange, isn't it? ;)
www.[edited].com 18.104.22.168 [20/Jan/2001:19:38:16 -0500] "/robots.txt" 404 - "-" "Mozilla/2.0 (compatible; T-H-U-N-D-E-R-S-T-O-N-E)"
Then notice in the link below dogpile is using texis which is the technology described on the thunderstone site.
So I guess texis comes with a spider and the dogpile catalog is using it, or t-stone is spidering for them.
But Thunderstone itself does maintain their own index/search site. You *can't submit your site to it*... They spider, and if they happen to find you (and like you), you're in. Their description also says they're concentrating on 'quality not quantity' with the material they index, and they seem to rely almost entirely ont heir spiders and software to manage it. Don't know how they managed to build a spider they could trust to judge 'quality'...
I have seen them hit many brand new sites that have no other sites linking to them... And, it began immediately after I submitted to several other engines.
Any ideas? Can anyone see any patterns in their logs?