Google Spidering Behavior

Is this common?

[JoeHouse]

Hi All

I have a bran new website

Just wondering if it is common if Google spiders your site four days after you have submit it, and picks up just a few of your pages and has not revisited your site again. Its been four days since Google last visit.

Is there reason for concern? Or is this normal?

Thanks!

[robotsdobetter]

This is normal Googlebot. Googlebot likely spidered so fast because they found a link to your web site and index it. Sometimes Google will just index a few pages and than a few days later index all of your site, so just give it some time, about a three months for a large web site.

While you wait you should make sure it's easy for Google to get around your site, you can start by creating a sitemap, so Google can find all of your pages 1 click away and make sure you use text links to your most important content. Build your backlinks from related sites to increase the chance of Google spidering you.

[Wizard]

If you want to speed-up a deep crawl of entirely new site, place deeplinks on frequently spidered, high pageranked page of other, older site.

I never tried this with hundreds of deeplinks, so I can't attest there is no penalty for abusing this, but I did it with several deeplinks of my new site (back in Feb when it was 2 months old with no tPR and only 4 pages indexed) and, as result, I had over 20 indexed and ranking.

Now, after PR update, I have PR 2 on main page of the new site, and PR 3 on deep pages I deeplinked to. Not a bad start I suppose.

[larryhatch]

Hi Joehouse: I agree this is fairly typical.
If anything, you are luckier than many to get spidered so soon. A lot of little
new sites wait for weeks or months before they are noticed at all by Google.

Years ago when my site first appeared, it took months for Excite to visit.
Just a little nibble and then nothing. Excite had a big building here in
Redwood City, CA BTW.

Then one day, all the lites went out in that building and the big sign came down.
My site is still up, fairly good SERPS in G and Y, but Excite is gone.

I'm glad I wasted no time "optimizing for Excite".
I didn't know the meaning of SEO back then, and hardly do now.
I forget who bought the Excite building, some outfit I never heard of. -Larry