Less Result Pages in Google for Yahoo, MSN & Wikipedia

[sunnyujjawal]

Sometime I go on clicking Next Next in Google in the end G stopped me at Page 100 but now even for big sites like Yahoo, Wikipedia, MSN & for itself Google put an end at 50-70 pages.

After that a message is displayed:

In order to show you the most relevant results, we have omitted some entries very similar to the 687 already displayed.
If you like, you can repeat the search with the omitted results included.

I can believe MSN, yahoo may have some similar/repeated results but this can't be possible for Wikipedia (results ending at Page 69). Does Google think Wiki's results are also similar/repeated.

[Robert Charlton]

Just to be sure... are you talking about [site:domain] searches...

...or about [site:domain keyword] searches?

I assume you're not talking about more general searches, without the site: operator.

[sunnyujjawal]

Just to be sure... are you talking about [site:domain] searches...

I am talking about [site:domain]

[tedster]

I see a similar pattern for site:wikipedia.com - a really weak showing as far as I can tell.

This pattern of site: SERPs not going nearly far enough has been growing in recent months. Used to be if there were over 1,000 indexed pages in a directory, then site:example.com/directory would return 1,000 pages. Then it was almost 1,000 pages. Then it started falling lower. And now it's lower still.

I honestly think this limitation is an artifact of some new data processing method at Google, rather than an attempt to hide data. But you never know when it comes to publicly available information. After all, the public link: operator has never been complete.

If Google is intentionally hiding some of the data from public scrutiny, I would understand that. However, I would also then like a chance to see my own full data within Webmaster Tools. Seeing an accurate picture of URLs indexed (by directory when appropriate) would be a very helpful service.

[spreporter]

indexed urls used appear by the site:domain.com/* now that is gone as well as the cached url on the SERPS, still though is working the command cached:mydomain.com , IMHO every SEO useful staff is slowly disappearing.