homepage Welcome to WebmasterWorld Guest from 23.22.173.58
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

    
Google Sitemap Indexed URLs going down
themoron1

10+ Year Member



 
Msg#: 4019014 posted 3:07 pm on Nov 4, 2009 (gmt 0)

Hi,

Can anyone help. I have a new site which I'm always adding new pages. I resubmit my sitemap to google about once a week and up until recently the 'Indexed URLs' has been going up. When I had 1000 pages, google had indexed about 400, when I had 1100, google went up to 990. I now have 1419 pages and now google's Indexed pages is going down. It's now at 850.

The crawler access is fine, the crawl errors only show 6 which I corrected a few weeks ago and there's only 37 HTML suggestions.

What am I doing wrong?

Thanks

themoron

 

goodroi

WebmasterWorld Administrator goodroi us a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



 
Msg#: 4019014 posted 1:08 pm on Nov 5, 2009 (gmt 0)

Submitting a sitemap helps Google discover urls. Sitemaps do not guarantee Google will index them or keep them in the index.

Google wants relevant & valuable pages in their index. To maike your pages relevant and more valuable make sure their is significant unique text on every page. It also will help if you have link juice flowing throughout the entire site.

ps I'm not sure if you are using Google Webmaster Central or doing a search on Google.com. If you are using a Google.com search you should be aware that the numbers ie "showing 1-10 of 850 results" are only estimated by Google. They are notoriously inaccurate. You should look at your analytics for accurate data to see what pages get traffic and what pages dont.

Good Luck

themoron1

10+ Year Member



 
Msg#: 4019014 posted 2:52 pm on Nov 5, 2009 (gmt 0)

Thanks for the reply.

I'm viewing the stats through the Webmaster Tools and understand that a site: search in google is not that reliable. The pages are all product pages so I'd have thought they were unique enough.

I do have my own stats but determining which pages aren't being hit isn't all that easy. I guess I'll have to write something in PHP to read the logs.

At the moment the indexed pages to total pages in the sitemap is around 60%. Is that normal or below average?

Cheers

themoron

goodroi

WebmasterWorld Administrator goodroi us a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



 
Msg#: 4019014 posted 1:12 pm on Nov 6, 2009 (gmt 0)

there isnt an average. it depends on your industry, your website and your content. i have worked on b2b websites that had product catalogs of over 100,000 items and it never had more than 10% indexed because the items were very similar to each other.

imagine trying to describe a significant and lengthy, keyword rich difference between a 1 inch gasket vs. 2 inch gasket. it wasnt exactly fun :)

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved