Does Google bot wait a set time before spidering a new site?

As a great way to increase Adsense revenue...

[nzmatt]

My experience has been that the big G bot may spider the index page of a new site but deliberately fails to spider deeper for a certain period. Is this clever a strategy to encourage a webmaster to pay for Adwords to get traffic underway after a website launch?

Does anyone have any recent experience of publishing a new website - and if so how long has it taken for G to spider deep and frequently?

I guess I need to know whether my site is not being spidered deep because it is not interesting to G bot, for some reason, or whether this is a new Google strategy!

[edited by: nzmatt at 9:08 am (utc) on Aug. 4, 2004]

[trillianjedi]

to encourage a webmaster to pay for Adsense

I think you mean AdWords.

Yes, I launch new sites all the time. Never had any delays - Gbot just gets stuck straight in. I do always kick start a new site with a few decent quality inbound links though.

Crawl depth, I'm convinced, is related to inbound links.

A site map won't do you any harm either.

TJ

[nzmatt]

Yes TJ, I did mean Adwords - you can tell how often I've used the service!

I was hoping that this lack of deep spidering was not just happening to my site.

Now I need to find out why the big G is not interested. I have several dozen inbound links. The site map is not on the home page, but this does not explain why Google has no attempted to spider all the other pages linked off the home page! We have been live for almost 2 weeks now and I'm starting to sweat!

Does anyone have a reason what could be wrong?

[trillianjedi]

We have been live for almost 2 weeks now

LOL - the impression I got from your first post was that you've been waiting months....

That's quite normal.

Forget about it - keep working on the inbound links, link the site map from the front page and wait.

Patience ;-)

TJ

[nzmatt]

So Google does have a policy of visiting a new home page, because it has been linked to, but not spidering deep for a certain period? It must do.

[billygg]

hey nzmatt, said u had a problem getting google to spider through the sub pages. i have one question for ya, u said something about a links map. just make sure u have links near the top of the page, that are not hotspots. i work for a company that has over 200 websites. and i noticed on a couple of our sites, we have a link map over the top banner, instead of text links. on those sites, google tends to not pick up the link map, unless it has been crawled for a while, or the main page is PR 3 or so. maybe this is ur problem, not sure, but, either get a site map link near the top, or true text links near the top.