Welcome to WebmasterWorld Guest from 188.8.131.52
Forum Moderators: martinibuster
How long does it take for Yahoo to include those pages in the index? (I am not talking about the rankings, simply to show indexed pages in domain:mysite.com)...
Nice to see all the old search engines in the same boat, google hid their problems better, but it's the same problem, yahoo avoids attention because nobody really cares about yahoo, which is silly, good serps are good serps, I'm doing well in yahoo and getting almost the same traffic from yahoo/msn as from google this month.
Still waiting on a site we added a few thousand pages to 4 months ago, not in main yahoo index from what I can tell, in fact yahoo dropped our indexed page count by about 150, but raised us to number one on our single target keyword, go figure. Just not enough room is my guess, simple math, pages have to go before your pages are let in, so no real schedule on that. And sites with a lot of pages get some dumped to make room for new sites, pretty sloppy, wish yahoo could get their stuff working better.
I have an older site that I changed the URL structure on about 8 months ago and only 11 of the new pages are in the index and I seen Slurp spidering all of the old pages about 3 days ago.
But I have a new site (3 months old) that got indexed right away with 34 pages in the index right now. The new site has over 100,000 pages and slurp continually spiders them deep but hasn't indexed them yet.
So I'd have to agree that 6 months is about right.
I also assume that the more links pointing at you, the deeper your pages get spidered and indexed.
That's not what I've seen, doesn't seem to make any difference at all, the pages get spidered very fast, then it takes a long time for new pages to get in, and old pages get dropped, no particular pattern I can see to that.
I really think that it is not planned behavior, but just no room in their index, that's what it looks like to me anyway, they're not trying to be the best, but I think they are trying to get new sites in, at the expense of number of pages in index of old sites. For some reason they've avoided the intensely passionate scrutiny that google's sandbox type thing gets, but I think it's very much the same problem, with the same cause, only not as consistently implemented as the sandbox.
Time to update from old url's/domain to new one, 6 months, however I don't think that was a timeline thing, I think they just fixed their 301 problem last week finally, so my guess is many sites, irregardless of when the 301's were put in place, were correctly listed.