Crawling Crawling Crawling but no Indexing

[Seattle_SEM]

Hey all,

I launched a new site in late September, and about 500 or so pages are "live" in Google's index, oddly enough ones that were crawled right away (9/23 timeframe). I have 60+ good inbound links looking at webmaster tools.

The problem is that google just keeps crawling the site, but never updating the index with that new content. What's really odd is through logfile analysis I can see that they've hit the same page (many pages) over and over, once every week or so.

Also, crawling has increased pretty dramatically over the past week.

Is this related to the october google changes [webmasterworld.com], or something seperate?

What do you all think? Any help is appreciated.
Thanks!

[tedster]

I think Google is preparing something behind the scenes and we'll all see it by November 1 or so - the "holiday search results" you know.

While Google is in this mode (at least what we've seen in the past) the basic spidering, especially for young websites, continues but their indexing is often in a holding pattern. There are some other comments in the thread you linked to about the SERPs getting a bit stale right now.

[Seattle_SEM]

Thanks for the reply, tedster!
Do you think Google is still in 'this mode'? I've seen what little content I have live get a bit fresher, but no big batch of new content that I'm hoping for has hit the index.

[SEOPTI]

Still stale for me, crawling is better than at the time the caffeine stuff started but still almost no indexing takes place.

[gn_wendy]

I saw that for one of my pages as well. Pushed out a couple of thousand pages. Google indexed around 600 right off the bat, and then it took 2-3 months and 2 sitemap updates for google to reach a "normal" indexing level.

The crawlrate was about the same the whole time.

[mcskoufis]

Crawling rate at GWT took a very high peak last night with some considerable extra traffic than normal, but things are back to where they were before the weekend now here...

[SEOPTI]

Still no indexing, it's really hard to index a new site at the moment.

[Seattle_SEM]

I agree SEOPTI.

[mcskoufis]

This is getting annoying. Have a couple of new sites up with unique content, doing content updates every day almost and still no luck. Deep pages are not even cached and its been almost a month already.

I'm afraid to get more links to the sites as they are new...

Any other ideas here?

[SEOPTI]

No ideas, I think we should wait until January, it all seems stuck at the moment.

More quality links did improve crawling but they did not improve indexing at all.