Welcome to WebmasterWorld Guest from 188.8.131.52
Forum Moderators: open
Please share your thoughts on this:
I recently saw Inktomi come in and crawl my site--it got through around 3,000 pages before going away.
A couple weeks later (Apr 10 or so) I get a few result pages back through Hotbot...but by a little bit of testing there were only 13 pages or so included in the index.
Why would Ink crawl so much and not include in the index? Or is there a bigger update of the index to come?
Not sure that is a good idea, they may well include you at some stage. Yes, Google Rules!, but Ink (through MSN) still provides about 10% of my SE referrals.
I have not read anything about how they decide which free pages to include, but they currently have all of my small site in their database.
I'm going to watch and keep track of how many pages they include in the index. As I write, Ink's in my site indexing *again* and is up to 2,500 pages or so *again*.
If these pages don't make it into their index within the aforementionned time period they're history.