Wonder why your blog posts are not indexing these two days?

[miozio]

If you've been having problems with your new blog posts here is the huge discussion: [google.com...]
I've posted around 20 new posts on my WP blog since the 18th, none of them were indexed... What about you guys?

[tedster]

The forum right now has a number of complaints along these lines. Thanks for the reference - it's good to know that you have company, even though it's still better not to have the trouble in the first place.

[goodroi]

for tl;dr people - seems google is having trouble with blog posts including blogger & wordpress sites & they are looking into the issue.

i'm surprised this is impacting blogger & wordpress. i'm having a hard time imagining what could have caused this.

[miozio]

It's a massive issue considering the "freshness" of content and the news from gigantic blogs like Mashable.

[epmaniac]

< moved from another location >

we have a reputable site which was quite popular in its industry,a pr 6...

in last 24 hours we have witnessed almost 80% drop in traffic

this website has loyal following where people post thousands of pages of new content daily... serp shows almost 80% vanishing of main index... sub domains are performing as they were before

before this drop we were enjoying all time high traffic, we have not been doing anything which was unacceptable to google....

boggles my mind really

[edited by: Robert_Charlton at 6:44 am (utc) on Oct 23, 2010]

[scottsonline]

We have noted big increases prior to big drops with apparent filters being flipped off and on or ingestion of new data. To your point our traffic with google was steady today bit out traffic from yahoo/bing and direct was up significantly. They continue to grow and are gaining slowly but steadily every week, every month. The increase over the last ten days was pronounced.

[Robert Charlton]

this website has loyal following where people post thousands of pages of new content daily...

Google has recently acknowledged that it's been having a problem which is now being fixed. A link to the Google statement by JohnMu was posted in the current update thread, but I'll make a note of it here as well. The problem appears to be affecting many sites that update frequently...

Google appears to have stopped indexing blogspot.com
[google.com...]

I just wanted to provide a short update. This issue should be resolved soon, but it will take a several days for everything to catch up and for these changes to be visible. I'll provide another update after the weekend.

In the meantime, there's no need to make any changes on your side. Content from your sites will continue to be indexed during this time (though perhaps at the moment not as quickly as before in some cases).

Thank you for your patience and for all the feedback!

This is on a Google support thread discussing blog links not getting indexed. It may or may not also relate to other types of indexing issues some are observing.

[frank72]

Just came here looking for this issue.
Since a couple of days ago my latest blog posts (wordpress blog)are not indexed anymore. Just got crazy trying to find out why!

Doesn anyone know if google has solved the issue?
My has been inthe industry for 4 years now and features 2500 articles so it is not a penalty because well...i didnt do anything wrong or against Google TOS

[Sgt_Kickaxe]

I posted an article 20 minutes ago and it's on page one of google vs 380,000 competitors. I'd say that's pretty quick and working well.

Am I reading this correctly and it's wordpress.com posts and blogger.com posts and not the wordpress platform that is slow?

I don't post on those so I'm not sure what their norm is as far as indexing speed.

[frank72]

Reading the Google Forum it looks like only Blogger and Wordpress blogs are affected.
Some users suggested to remove the canonical tag temporary as it is the culprit

[Robert Charlton]

JohnMu did suggest not making any changes on your own site, and I would tend to trust him.

It could well be that the canonical change reported on the Google thread happened after Google fixed the problem. As Sgt_Kickaxe reports, his blog is apparently working well now, though he doesn't mention whether he has a canonical tag on it.

[indyank]

As John Mu stated, you don't have to change anything at your end.

The problem is something else at google's end and nothing to do with canonical urls. Yesterday I was following that thread and i even noticed a few people reporting feedburner urls to be the root of the problem.Sometimes people make crappy guesses when they loose their cool.So don't keep changing things around and leave it as it is.

There just seem to be a delay in serving the indexed posts on the serps.

[setzer]

Our articles are indexed instantly -- well, usually within 5 minutes of posting. It's a self-hosted WP blog though.

[scottsonline]

I'm looking at a site in the top 1000 in viewership in the US, nothing update since 10/19 in google still this am.

[miozio]

My other static sites (not blogs)update well now and i had issues with that. So the priority that Google gives to blogs might be wrong. They are using all their power these days to crawl static sites.

I guess, when things turn back to normal, this fast indexing of blogs will be history and the speed will level up. It might work the normal way as with static sites where the spead of indexing depends directly of the quality and ammount of backlinks.

[epmaniac]

final verdict:

google engineers messed up something which was to do with canonical tags/ duplicate content and to fix it, they have turned on the strictest duplicate content filters.... which is causing many sites to vanish aka get dropped in ranking

what do u guys think?

[Lame_Wolf]

they have turned on the strictest duplicate content filters.... which is causing many sites to vanish aka get dropped in ranking

Is that a bad thing ?
Do we want the SERPS flooded with duplicate/rehashed content ?

[Robert Charlton]

final verdict

Whose final verdict?

[miozio]

I've noticed that the new Tag pages get indexed but the posts are still in oblivion...

[frank72]

I am still in trouble with these indexing issues. No sign of my last posts. What's worst is that some blogs which scrape my content and posts...have my content and my posts indexed while mine is no where!

[Future]

Problem appears to be fixed now, can observe proper indexing (like week before)on few blogs.

[miozio]

The new post from today got indexed the ones from before not

[Stijn]

I had noticed an inexplicable 70% traffic drop on my self-hosted WordPress site. Hopefully it is (only) due to Google screwing up.

[tedster]

Hey, welcome to the forums, Stijn. Those certainly can be heart-stopping moments, can't they? Especially if your blog has some strong monetization that you've grown accustomed to.

[scottsonline]

Yep major political blog is updating again.

[incrediBILL]

I've posted around 20 new posts on my WP blog since the 18th, none of them were indexed.

Let's get some facts.

Is there a googlebot crawl problem or a google indexing problem?

Were the those posts crawled? and if so, when?

Not having them indexed doesn't mean anything until they've been crawled.

If you're not sure, check your log files from the 18th forward and look for either googlebot, mediapartners-google or adsbot-google having accessed those pages. Also, if you're on feedburner, check to see if feedburner accessed your RSS feeds, etc. Regardless of what you see in the index, it's always best to make sure the crawl is happening for those pages because technical errors, like sudden failure to update sitemap files if you use them, can possibly cause googlebot to stop crawling new content.

Once you're sure they've been crawled, then it's obviously an index updating problem.

It does look like Google may be having some sort of a crawl or index update problem based on just the recent volume of complaints but I'm not personally seeing it. There appears to be a real problem with blogspot, but those are both Google properties and nothing we can do to diagnose where that problem lies.

Worse case I ever saw was a hacked site where for whatever reason the hacker tampered with the robots.txt file and blocked all bots!

[pawas]

I am having same problem for all of my blogs. Not a single new post indexed for last few days.

[g1smd]

Were the posts CRAWLED in the last few days?

In other words, is the problem one of data collection or one of indexing or display?

[dataguy]

My new content was crawled, but not indexed.

Seems to be mostly corrected now, even the posts on Wednesday (the first day of this problem) have been indexed and are now receiving traffic.

[frank72]

I am still suffering from the indexing issue. All my posts published after oct 22 are being indexed very slowly and they tend to rank slow in the SERP (other articles and keywords not affected). They are so low that a blog which scrapes my content rank MY articles higher than my original ones!
I have filed a reconsideration and a spam request to Google webmaster tools but i dontknow what to do!
Three hours ago i published two articles but nothing...they are nowwhere!

What should i do?