homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Visit PubCon.com
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

Google Sitemap Indexed URLs going down

 3:07 pm on Nov 4, 2009 (gmt 0)


Can anyone help. I have a new site which I'm always adding new pages. I resubmit my sitemap to google about once a week and up until recently the 'Indexed URLs' has been going up. When I had 1000 pages, google had indexed about 400, when I had 1100, google went up to 990. I now have 1419 pages and now google's Indexed pages is going down. It's now at 850.

The crawler access is fine, the crawl errors only show 6 which I corrected a few weeks ago and there's only 37 HTML suggestions.

What am I doing wrong?





 1:08 pm on Nov 5, 2009 (gmt 0)

Submitting a sitemap helps Google discover urls. Sitemaps do not guarantee Google will index them or keep them in the index.

Google wants relevant & valuable pages in their index. To maike your pages relevant and more valuable make sure their is significant unique text on every page. It also will help if you have link juice flowing throughout the entire site.

ps I'm not sure if you are using Google Webmaster Central or doing a search on Google.com. If you are using a Google.com search you should be aware that the numbers ie "showing 1-10 of 850 results" are only estimated by Google. They are notoriously inaccurate. You should look at your analytics for accurate data to see what pages get traffic and what pages dont.

Good Luck


 2:52 pm on Nov 5, 2009 (gmt 0)

Thanks for the reply.

I'm viewing the stats through the Webmaster Tools and understand that a site: search in google is not that reliable. The pages are all product pages so I'd have thought they were unique enough.

I do have my own stats but determining which pages aren't being hit isn't all that easy. I guess I'll have to write something in PHP to read the logs.

At the moment the indexed pages to total pages in the sitemap is around 60%. Is that normal or below average?




 1:12 pm on Nov 6, 2009 (gmt 0)

there isnt an average. it depends on your industry, your website and your content. i have worked on b2b websites that had product catalogs of over 100,000 items and it never had more than 10% indexed because the items were very similar to each other.

imagine trying to describe a significant and lengthy, keyword rich difference between a 1 inch gasket vs. 2 inch gasket. it wasnt exactly fun :)

Global Options:
 top home search open messages active posts  

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved