How to find pages not indexed by Google

[cosmonaut]

Hi,

I have a text sitemap of a few thousand pages. Google webmaster tools indexes 95% of them. But I want to find the 5% not indexed.

Is there any way (except for searching google for them one by one) to find which files are in this 5%? I use webmaster tools and analytics - is there somewhere in there where they are listed perhaps?

Any other tool?

Thanks so much for your time answering

[ergophobe]

How about starting with your pages that get zero referrals from Google. Whether indexed or not, those would be good pages to work on.

[cosmonaut]

ok, thanks. Where would I find that info please?

[kaleemahmad]

Hi

Check all pgaes in Google webmaster tool. whether indexed or not indexed, those pages working. All pages will be indexed soon by Google.

[lucy24]

Where would I find that info please?

That depends on how you handle your own record-keeping. Logs, analytics, what have you.

This is all assuming that
-- #1 site and sitemap have been stable for a long time, and certain pages remain stubbornly un-indexed.
-- #2 you've verified by other means (such as a site: search) that some of your pages are genuinely not in google's index

If we're talking about pages that google has only known about for a few weeks, give them time. And don't rely on gwt as a definitive source of information; it can be notoriously hiccupy. Matter of fact, there's a thread started within the last day or two involving links that simply disappeared from gwt. They do this to everyone periodically and it doesn't mean anything.

[ergophobe]

How many total pages on your site?

If it's just a few hundred, you can do a site: search with the "show similar results" option, scrape those results and then compare that list to your list of site URLs.

[timbarnard]

Yes you can type "site:domain.com" in google you will get your all indexed pages of your website.