Welcome to WebmasterWorld Guest from 22.214.171.124
Forum Moderators: open
In my experience Jeeves has been updating on about a 6 weekly(ish) schedule - although it is more than 6 weeks since the last update, perhaps they want to get a bit more data.
Updates tend to be at weekends too (last 2 or 3 I think) - if it is still crawling it might be to early for this weekend.
I'm not sure if there is any cause-effect relation here, but my single 3-letter keyword brought my site up on the first page, #10 out of 1.7 million. I can't complain.
Yep. And if ask.com was the dominant search engine I could get filthy rich doing professional SEO. Ask.com isn't an easy nut to crack, but once you know exactly how to do so it's easy to rank well.
The about of data added to the index compared to the amount of pages crawled for my sites was only a very small percentage.
Bit of a waste of bandwidth unless these pages do get added. :(
Every now and then it triggers my mod_throttle rules (too many pages accessed by one IP in a given time frame). I then return a 503 error code. But it just carries on pounding away, ignoring that for hundreds more pages...
Of course, none of the tens of thousands of pages it grabs per day are indexed yet. It just has one page from the site in the SERPS, a holding page from many months ago.
A key to the search engine wars is comprehesive, fresh results. They seem to be trying a bit hard for the first part of that, and failing totally on the second part.