Welcome to WebmasterWorld Guest from

Forum Moderators: Robert Charlton & goodroi

Message Too Old, No Replies

Is Google reluctant to deep crawl new sites lately?

6:59 pm on Aug 1, 2006 (gmt 0)

New User

10+ Year Member

joined:Aug 9, 2002
votes: 0

I have a domain which I purchased in anticipation of starting a new business in 2004. The domain was previously registered, but based on my research it was a completely legitimate site with no bad practices. Between 2004 - May 2006 I had a temporary 5 page site placed on the domain which Google eventually spidered.

About 8 weeks ago we placed our new site on the domain, which has about 1000 pages of unique product content. Since then we've added a few more solid backlinks, but Google still has not crawled beyond the index.


1. Site has good quality 1-way backlinks
2. Site currently has a PR4
3. Google has indexed and cached the index page
4. Index page terms do rank decently for niche phrases
5. Sitemap submitted and retrieved by Google on numerous occasions
6. No reciprocal or 3-way link exchanges
7. Pages are mostly static and there are no session ID issues
8. Robots.txt is compliant and does not disallow any spiders currently
9. There are no other mechanisms in place such as .htaccess that could disallow Google in any way

I'm concerned that there may be an issue at this point. Is Google just slow to index new sites in light of recent problems or do I have a legitimate concern at this point?

9:52 am on Aug 2, 2006 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:June 13, 2003
votes: 0

They do seem slow to index new sites everything you have done looks good and the only thing I would worry about for yours is
"The domain was previously registered"
as this has caused me problems in the past as a domain 1 purchased I found after lots of investigation trying to find out why never fully indexed had been used previously for spam mail and the domain did have PR4 but never got indexed by Yahoo or Google

Eventually I was forced to give up on it and use another domain for the project which was indexed fully using the same process of linking, bloggs and Press Release in 4 weeks became PR3 on first little green bar update ( indexed fully 400 pages not good serps results which took a further 5 months )

I am sure that many who do buy existing domains do get quicker results and serps but I think it is a gamble you take.


4:55 am on Aug 10, 2006 (gmt 0)

New User

10+ Year Member

joined:Aug 9, 2002
votes: 0

Unfortunately using another domain isn't a completely viable option, it's the exact name of our business.

Googlebot comes by and picks up robots.txt and the index page daily, and the current cache of the index shows August 3.

Could the lack of deep crawling indicate some sort of penalty? I see sites that are a month old fully indexed, so you can imagine my frustration.

1:01 pm on Aug 10, 2006 (gmt 0)

Junior Member

10+ Year Member

joined:Mar 7, 2003
votes: 0

8 weeks is still pretty early to expect much from google... don't worry though, soon you'll have some nice fresh supplemental pages to look at (to bad no one else will though).

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members