Welcome to WebmasterWorld Guest from 54.144.3.134

Forum Moderators: bakedjake

Message Too Old, No Replies

Has anyone heard of Walhello.com

got spidered by this search engine

     
2:30 pm on Mar 15, 2002 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:June 29, 2000
posts:920
votes: 0


It's a search engine in many languages. But it looks really tacky. I'm just curious to know how they found our site.
2:51 pm on Mar 15, 2002 (gmt 0)

Senior Member

WebmasterWorld Senior Member jeremy_goodrich is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Aug 4, 2000
posts:3468
votes: 0


At present the database contains about 30 million web pages

from their about page.

that's not a bad start, but for nearly two years of work, I would expect for a lot better - Teoma, Wisenut both being great examples of about two years of amazing work by relatively small groups of people.

though that does solve the mystery of the 'appie spider' for me now :)

7:09 am on Mar 16, 2002 (gmt 0)

Junior Member

10+ Year Member

joined:Mar 1, 2001
posts:183
votes: 0


I use to see appie often but a little while after I put a robots.txt file up for the site, it stopped grabbing pages and they are not even banned.

I never did submit to them, maybe they found the site from odp.