advanced google search missing pages

are pages filtered out by cache date or is there a limit to pages shown

[latimer]

We used to find certain types of our pages that were in the google index by doing an advanced domain search using part of the url common to all those pages as the search term.

This still works somewhat, but doesn't show all the pages. When doing the search for portion of url in advanced search, seems to be limited to around 10,000 pages or so. Some of the pages show up, and some that should be in there don't? Yet when searching for other words on the page doing a normal search, we can find pages that are missing in the advanced search index showing up in the regular index.

Is google limiting the number of results in the advanced search? This would explain why some that show up in the regular search don't show up in the advanced search. Or, is there some other filter being applied, perhaps google doesn't show pages beyond a certain cache date in the advanced search, even though they are still able to be found in the regular search.

Any thoughts on this appreciated.

[tedster]

Google is limiting the number of pages returned on every search these days. Even a search with billions of results is truncated before you get to 1,000.

I can't quite figure all the ins and outs, but there does seem to be a new approach in play - most likely to help with the huge and exploding scale of today's web.