Forum Moderators: goodroi

Message Too Old, No Replies

How to find pages not indexed by Google

         

cosmonaut

12:32 pm on Dec 1, 2014 (gmt 0)

10+ Year Member



Hi,

I have a text sitemap of a few thousand pages. Google webmaster tools indexes 95% of them. But I want to find the 5% not indexed.

Is there any way (except for searching google for them one by one) to find which files are in this 5%? I use webmaster tools and analytics - is there somewhere in there where they are listed perhaps?

Any other tool?

Thanks so much for your time answering

ergophobe

9:04 pm on Dec 7, 2014 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



How about starting with your pages that get zero referrals from Google. Whether indexed or not, those would be good pages to work on.

cosmonaut

2:29 am on Dec 8, 2014 (gmt 0)

10+ Year Member



ok, thanks. Where would I find that info please?

kaleemahmad

4:59 am on Dec 8, 2014 (gmt 0)

10+ Year Member



Hi

Check all pgaes in Google webmaster tool. whether indexed or not indexed, those pages working. All pages will be indexed soon by Google.

lucy24

5:55 am on Dec 8, 2014 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Where would I find that info please?

That depends on how you handle your own record-keeping. Logs, analytics, what have you.

This is all assuming that
-- #1 site and sitemap have been stable for a long time, and certain pages remain stubbornly un-indexed.
-- #2 you've verified by other means (such as a site: search) that some of your pages are genuinely not in google's index

If we're talking about pages that google has only known about for a few weeks, give them time. And don't rely on gwt as a definitive source of information; it can be notoriously hiccupy. Matter of fact, there's a thread started within the last day or two involving links that simply disappeared from gwt. They do this to everyone periodically and it doesn't mean anything.

ergophobe

4:15 pm on Dec 8, 2014 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



How many total pages on your site?

If it's just a few hundred, you can do a site: search with the "show similar results" option, scrape those results and then compare that list to your list of site URLs.

timbarnard

9:10 am on Jan 10, 2015 (gmt 0)

10+ Year Member



Yes you can type "site:domain.com" in google you will get your all indexed pages of your website.