joined:Feb 19, 2012
We have our site's sitemaps split into various ones for different areas of our site. The total number of submitted urls is close to 300,000.
Most of the sitemaps are indexed at about a rate of 80% . I assume this is relatively normal for large numbers of urls.
But one sitemap has 21,000 urls submitted and only 1,200 of those are indexed. This sitemap is full of user profiles. There's half a million in total, so this is a very very small subset; only the ones that have displayed a reasonable amount of activity. Which in turn means the profiles are all linked from various other areas of the site also, so it's somewhat perplexing that they wouldn't be indexed.
What could be the explanation for such poor indexing of these urls? I'm not seeing any crawl errors in WMT related to it.
To be honest, they don't really matter that much to me, because I'm more interested in getting other areas of the site indexed. But the ratio is somewhat perplexing and I'm kind of wondering whether I should make only an even smaller subset open to crawling. Is Google just totally uninterested in indexing user profile pages and flat out ignoring them if they don't have lots and lots of links / content on them?