grub.org

Is this data being used anywhere?

[ncw164x]

My sites get spidered very heavy by grub-client-2.3 sometime taking 4 - 5 pages a second, That does not bother me but is this data being used by any search engine.

Last year I contacted grub.org who replied by saying have a look on the forum to see where the info is used but there is was posting relating to which or what search engine actually uses this database.

Does anyone know?

[GameMasterM]

Grub is an exciting software program. LookSmart so far has done nothing commercially viable with the tech. Using others machines to scour the web is brilliant.

[ncw164x]

I dont dispute the fact that it is exciting software, it's one thing taking 1000's and 1000's of pages sucking up gig's and gig's of bandwidth but is this information being used anywhere.

On the grub site it has information saying has been merged with wisenut but wisenut also spiders my sites so you can't say the info is being used on wisenut?

[Lord Majestic]

Data is supposed to be used on www.wisenut.com, but I question whether it actually happens. If you look carefully at grub's website you will see that is rarely updated, forums are not active, and while a handful of people do run it they still manage to crawl impressive number of URLS - 30 mln a day in July (falling rapidly though), so after just 120 days theys hould have matched Google's database, yet the highest number attributed to WiseNut that I've seen was something just above 1 bln.

Given that LookSmart is on its way down and just looking to sell to the highest bidder (or any bidder in their situation) I think its (sadly) a lost cause, shame so many people's work will be gone... but who knows, perhaps future holds something good for them?

Disclaimer - I do have conflict of interest but its a bit too early to tell what exactly that is, but take my words with a pinch of salt anyway ;)

[cabowabo]

Two years ago I had the grub bot on my system to help build the index. That lasted about two months after not seeing any results from the effort. Wisenut was mentioned, but in the server logs the wisenut bot was also there, so I agree with the other posters, where is the information being used? It is/was a good idea, but no implementation is disappointing.

Cheers,

CaboWabo