Forum Moderators: bakedjake
I have been getting hit like mad from the WISENutbot (Between June & July - getting about 80% of my pages), and I have never paid to be listed in the Looksmart directory.
My question is: is it worth allowing it to trawl my site and shall I ever get a listing in either wisenut or looksmart?
Also when does it update the dB in either of the above SE's, I have read through some older posts dated last year with nothing really set fast and sure about its update cycle/process to help me answer this question, I was hoping that some of you guyz might be able to assist me :)
Thanks in advance.
KR,
-gs
Wisenut's bot has regularly and consistently hit many of my pages since the search engine first launched, and even more often recently. However, despite all this use of my bandwidth, it still displays pages from many months ago that haven't existed for some considerable time.
Although wisenut seemes quite promising early on, it never updates and its results are therefore poor. They seem to have a crawl schedule, but no indexing schedule.
If you ask me Wisenut is a complete waste of time. You won't get any traffic from it. If it continues to take pages from my sites but not index them (it's second only to Google and Inktomi on some sites in terms of bandwidth and frequency of visits) I will just ban their bot and that will be that.
Naturally, I will be keeping an eye on what they're up to on the off chance that they ever decide to become a real search engine ;)
This is an engine that is fully working and out of "beta" and has been for a while. Though now, when you read the "about page" on WiseNut, you see it says,
WiseNut is a LookSmart search engine
I take that to mean, they don't intend to index the web anymore (as previously they did when they debuted with a number of pages indexed very similar to the Google number of the day - 1.6 billion).
<added> LookSmart bought WiseNut in the 1st or 2nd quarter, 2002 - so they have had well over a year to integrate, upgrade, etc the technology that powers the thing to do whatever they planned on doing. In similar time frame since Gigablast has been released, they (with far fewer resources) have accomplished a lot more so I highly doubt LookSmart has any "significant" plans for this one.
</added>
Jim
I did a search for Google news and the date that appeared was the 5th of March. I'm not really seeing any dates later than that.
I highly doubt LookSmart has any "significant" plans for this one.
The infamous grub dataset will most likely appear sometime this Autumn on Wisenut, whether it is as a testbed or not I'm not sure.
Rob
[edited by: jrobbio at 11:54 am (utc) on July 18, 2003]
Wisenut actually has updated!
But not very well for my site - Funny thing being Wisenut has managed to index iframes that are in the pages rather than than the page the iframe is in. I have got a noindex, nofollow on the iframe contents too but cant remember when I added that or when wisenut crawled.
Wonder why it has not indexed the page that contains the iframe though. - Anyone else seeing problems with frames or iframes?
Anyway at least there is sign of life.
I take that to mean, they don't intend to index the web anymore (as previously they did when they debuted with a number of pages indexed very similar to the Google number of the day - 1.6 billion).
I am not in Looksmart/Zeal and do get crawled by Zyborg - so I assume that Wisenut do still plan to index the web.
Having said all this - it is hard to get excited about Wisenut :(
WiseNut, for how long they've been in development & owned by a publically held company, has always been a colossal dissappointment. Even if they *do* integrate the grub distributed results, that won't fix their ranking algo, as distributed crawling only helps an engine have a bigger database.
Ranking it well, is still yet to be solved by their team, imho, though I'm sure they are working on it. Time will tell if they ever fix it.