homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Google / Google SEO News and Discussion
Forum Library, Charter, Moderators: Robert Charlton & aakk9999 & brotherhood of lan & goodroi

Google SEO News and Discussion Forum

Google Spidering Behavior
Is this common?

10+ Year Member

Msg#: 29141 posted 8:20 pm on Apr 21, 2005 (gmt 0)

Hi All

I have a bran new website

Just wondering if it is common if Google spiders your site four days after you have submit it, and picks up just a few of your pages and has not revisited your site again. Its been four days since Google last visit.

Is there reason for concern? Or is this normal?




WebmasterWorld Senior Member 10+ Year Member

Msg#: 29141 posted 1:49 am on Apr 23, 2005 (gmt 0)

This is normal Googlebot. Googlebot likely spidered so fast because they found a link to your web site and index it. Sometimes Google will just index a few pages and than a few days later index all of your site, so just give it some time, about a three months for a large web site.

While you wait you should make sure it's easy for Google to get around your site, you can start by creating a sitemap, so Google can find all of your pages 1 click away and make sure you use text links to your most important content. Build your backlinks from related sites to increase the chance of Google spidering you.


10+ Year Member

Msg#: 29141 posted 6:29 am on Apr 23, 2005 (gmt 0)

If you want to speed-up a deep crawl of entirely new site, place deeplinks on frequently spidered, high pageranked page of other, older site.

I never tried this with hundreds of deeplinks, so I can't attest there is no penalty for abusing this, but I did it with several deeplinks of my new site (back in Feb when it was 2 months old with no tPR and only 4 pages indexed) and, as result, I had over 20 indexed and ranking.

Now, after PR update, I have PR 2 on main page of the new site, and PR 3 on deep pages I deeplinked to. Not a bad start I suppose.


WebmasterWorld Senior Member 10+ Year Member

Msg#: 29141 posted 12:40 pm on Apr 23, 2005 (gmt 0)

Hi Joehouse: I agree this is fairly typical.
If anything, you are luckier than many to get spidered so soon. A lot of little
new sites wait for weeks or months before they are noticed at all by Google.

Years ago when my site first appeared, it took months for Excite to visit.
Just a little nibble and then nothing. Excite had a big building here in
Redwood City, CA BTW.

Then one day, all the lites went out in that building and the big sign came down.
My site is still up, fairly good SERPS in G and Y, but Excite is gone.

I'm glad I wasted no time "optimizing for Excite".
I didn't know the meaning of SEO back then, and hardly do now.
I forget who bought the Excite building, some outfit I never heard of. -Larry

Global Options:
 top home search open messages active posts  

Home / Forums Index / Google / Google SEO News and Discussion
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved