Welcome to WebmasterWorld Guest from 220.127.116.11
Forum Moderators: open
I'm curious if their has been lots of improvements in slurp since the acquisition, and if it has made their crawler more effective.
I think the biggest lesson G has taught all the other engines is that to be successful, you need to aggressively crawl the web and you must also be consistent about it.
Conducting a massive crawl every 6 months just doesn't cut it. I think Ink understands that. So I would expect to start seeing Slurp on a regular basis in the upcoming months.
I forget who ended up owning Alta Vista, but I assume that's where this spider is from.
I find it quite natural to expect Yahoo to make much more use of Inktomi, which might very well include creating a much larger and much more up to date database.