Google is stale

New content spidered on October 3rd not in index

[yankee]

I had a new site deep crawled 17 days ago, but only the index page is in Google. The other 10 pages spidered are still not in the index. These are the content pages, not the index page. I thought Google was supposed to be including new content quicker than 17 days. Is anyone else in the same boat?

[WebGuerrilla]

I don't think anyone ever said all new content would be included quicker. Your homepage got in in 17 days. I can remember a time when it tool quite a bit longer than that.

[whats up skip]

There is no doubt about it, Google is "out of date" at the moment. There has not been a good update for six weeks. We just have to sit and wait.

Just hope it does not go on for 3 months like it did last time there was a big delay.

[kevinpate]

I guess it all depends. On our NFP org. info site, it looks like this:

Main index page:
cached less than 5 days ago, no visible fresh tag
Widgets Supplies Brick and Mortor location Info
cached 4 days ago, no visible fresh tag
Regional Widget Honchos page:
cached less than 11 days ago, ditto on no fresh tag
Widgets in the Great Outdoors page
cached right on 3 weeks ago

That's not very stale, but then again, we have been feeding the spiders far more in the last 72 hours than what's currently visible. Perhaps when the morn comes again, perhaps not. Either way I'm reasonably happy tonight.

[yankee]

Pages in the index are getting "freshed". This thread is about new pages of content not getting INTO the index.

[Tomas]

I had a new site deep crawled 17 days ago, but only the index page is in Google.

Don't worry it will get into the index soon. I had the same situation with one of my sites; it took about 3 weeks to get into the index after deep crawl.

[BigDave]

Yankee,

It isn't really about new pages not getting into the index, it is about pages on a new site.

Google seem to always take a bit longer to get a new site completely into the index than it does to get pages on an existing site.

But at least on my sites google is taking longer to pick up new deep pages this month. the crawl seems to be running at a lower rate than last month too.

Oh well, nuthin you can do about it but sit and wait.

[dirkz]

Are your pages now indexed?

I remember a lot of deep pages crawled around that time that I found but now in the index the first time (after reading this post).

[yankee]

Nope, still not in there. I don't mind waiting, but Google isn't living up to it's own hype about being fresh!

[dirkz]

I suppose it's dependent on PR. I wouldn't call my pages that now are in the index fresh either :) They were changed a lot since then.

[kaled]

I'm not seeing any problems. Modifications to my site were picked up in a few days and judging by SERPS, new backlinks are gradually being picked up.

I think most members of WW know that I'm happy to criticise Google when I feel it's warranted, but I don't think it is right now.

Unless Google's engines are revving much harder than now than they did during the days of the dance, average update times are likely to still be in the region of 3-5 weeks. Presumably high PR sites get priority (at depth) so low PR sites will take longer - that probably includes new sites since, even if there are many backlinks, they still need to be detected.

Kaled.

[BigDave]

I'm kind of out of the hype loop, but I don't ever recall Google hyping their fresh results. In fact I don't ever remember them hyping anything.

Google still says that it can take up to 6-8 weeks to get into their index. Anything quicker than that and I consider it a bonus.

All the hype that I have heard is from other webmasters when they find some feature. By the way, I do not consider GoogleGuy "sharing" some information here on WW to be hype.