homepage Welcome to WebmasterWorld Guest from 54.167.238.60
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Alternative Search Engines
Forum Library, Charter, Moderators: bakedjake

Alternative Search Engines Forum

    
Has anyone heard of Walhello.com
got spidered by this search engine
backus




msg:462968
 2:30 pm on Mar 15, 2002 (gmt 0)

It's a search engine in many languages. But it looks really tacky. I'm just curious to know how they found our site.

 

jeremy goodrich




msg:462969
 2:51 pm on Mar 15, 2002 (gmt 0)

At present the database contains about 30 million web pages

from their about page.

that's not a bad start, but for nearly two years of work, I would expect for a lot better - Teoma, Wisenut both being great examples of about two years of amazing work by relatively small groups of people.

though that does solve the mystery of the 'appie spider' for me now :)

Son_House




msg:462970
 7:09 am on Mar 16, 2002 (gmt 0)

I use to see appie often but a little while after I put a robots.txt file up for the site, it stopped grabbing pages and they are not even banned.

I never did submit to them, maybe they found the site from odp.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Alternative Search Engines
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved