"you repeat the search with the omitted results included"

[The Subtle Knife]

This is really baffling search results were
appearing in the 1st page (even top 10) this may
be to FreshBot, but now they don't appear at all!

BUT, in the footer of the first page it says"

"In order to show you the most relevant results we have omitted some entries very similar to the 96 already displayed, If you like you can <repeat the search with
the omitted results included> "

So is this a two level system now?

How does google decide that you get omitted, clearly your relevant! Age of site?

Has anyone experienced this? Thoughts?

[ikbenhet1]

duplicate content/almost duplicate content/doorway-pages/same titles

[MeditationMan]

Hi Subtle Knife,

This isn't new -- Google's had this going for years.

Generally I've found that the omitted results are further pages from sites listed in the results or are virtually identical copies.

[Dynamoo]

It's actually pretty clever.

Let's say I'm looking for something that appears in the footer of every page, like a copyright notice, for example "(c) WebmasterWorld.com 1998-2003". Google understands that as far as my query is concerned most of the 76,600 are basically the same, despite the fact Google understands that all the pages in Webmasterworld are different and indexes them as individual, unique content.

In other words, Google things that the results are all the same, but only as far as that query is concerned, even though the pages are almost completely different.

[The Subtle Knife]

mmm Interesting, the sites all have unique content..
I think they need a closer look though,
I assume google's algo is tighter than it was a few months ago! As the pages haven't changed that much at all.

[ikbenhet1]

It also happens when the snippets are the same.

Do you have 1 line of text that is on all those omitted pages wich includes the keyword you are searching for?

[Trodda]

That is interesting. What I would like to know is whether links from "omitted pages" count as much towards your PR as pages that appear automatically. By not showing them, is G saying they do not add much value?

[Canary]

I do get concerned by the pages omitted, - are these pages flying a bit close to the wind as far as duplicate content goes?

EG - If I do an allinurl search on one of my sites I only get two results and the other 100 odd are omitted - does this mean I only have two relevant pages for a seach on my domain? :(

Likewise an allinurl search on www.webmasterworld.com only returns 25 result with the other 76,675 being omitted.

76,765 pages of near duplicate content - dont think so (Mind Google Update threads could be near duplicate content :) )

[Chris_D]

I think this is pretty innocent - and I think there are actually 2 ways Google shows this to searchers.

I believe Google only shows 2 pages from a domain as a 'default' - ie, as a general rule. Nothing about spamming - think innocent search, clean results, search happened to be a 'brand' eg widgets.

So there are 2 scenarios:

1. Sometimes - under the second result, you get a hyperlink labelled: "more results from www.widgets.com" - click on this link and it will give you a new search window in the format "site:www.widgets.com widgets" - and will show you every occurance of the same previous search term, on that specific site.

2. Sometimes - at the end of the serps, you get "In order to show you the most relevant results, we have omitted some entries very similar to the XX already displayed.
If you like, you can repeat the search with the omitted results included."
When you click on this hyperlink, it is my understanding that Google then shows you these "extra pages" (ie over 2) - from ALL the same domains as it already listed.

So - Google by default gives you Maximum two 'most relevant' results from any domain. Google then gives you two ways to dig deeper
1. relates to being able to see all the valid results from a single domain in that serp
2. relates to seeing all the valid results from ALL the domains in that serp.

Thats my understanding anyway - nothing to be concerned about, Google just shows the 2 'most relevent' results from a domain by default - and gives you two options if you want to see more from the same domain(s).

I think the only takeaway is that these 2 displayed pages are what Google deems as 'most relavent' for that search.

Maybe Googleguy can clarify?

[Canary]

Chris_D

You may be right there - further to my post, although an allinurl search shows 25 results only 2 are from www.webmasterworld.com

[Trodda]

OK, I understand the relevancy notion, but suppose you are using the "link:www.widgets.com" command. If you only get 2 results and get the same message "we have omitted some entries very similar to the XX already displayed". Does this mean you only count 2 links for your PR value, or do you count the 2 links + the other 5 that were included in 'omitted'?

[mil2k]

Google does not show all results to maybe prevent reverse engineering of their algo. The reverse engineering of their algo has been tried before and hence maybe this is their answer. To all those who have PR concerns the easiest way to check whether a link on a particular page counts or not towards PR is to enter the url in google. If google shows result for that url then the Page should be in their index and logically count towards PR.{under normal circumstances}