When does google crawl new links ?

[bcc1234]

Hi,

If I have pageA.html and it has a link to pageB.html (none of them are in the index yet).
And the googlebot visits pageA.html, will it also visit pageB.html in the same crawl or only after the update, in the next crawl ?

Thanks.

[Hunter]

A long as your links are accessible from your index page and not buried too far away from the root, all of them should be crawled during the same Google crawl. Make sure that all of your pages are linked to your index page, if not directly then at least thru a site map that is.

[bcc1234]

Make sure that all of your pages are linked to your index page, if not directly then at least thru a site map that is.

You mean a link from every page to home, or from home to every page ?

[Hunter]

Site map to every page to home is preferable unless you don't have many pages.

[jaytierney]

It will crawl it during the same visit. However, with links to other sites, Google seems to keep that information one month behind (so if you link from site A to site B, it will take two updates before it counts).

[bcc1234]

Site map to every page to home is preferable unless you don't have many pages.

I got about 1,000 pages, got indexed about 200 of them last night.
I guess I'll wait for this crawl to finish and then start working on the site map.

[nube]

"A long as your links are accessible from your index page and not buried too far away from the root"

does the same apply to subdomains, i thought that subdomains are treated by google as separate domains, so does it matter how far from root you are with subs..?
thanks

[astounded]

Will this work to be found by the spider?

Right now I have about 50 pages, but will soon have more than 100.

All the pages are in the root. No subdirectories.

The structure of the site is set up so that there are about 10 main chapters, and there are links to these main chapters on every page in the site.

Under each main chapter page are 5-10 other pages, and the only link on the site to them is from the previous page. So, the main chapter pages (main.html) have tons of links going to tthem, and also a Site Map going to each main.html page. But all the pages under those main pages (main-1.html, main-2.html etc.) have only one link going to them, and that is from the proceeding page.

Will this work for the spider? Will Google find these and thus help my page rank for the main pages?

[huppy99]

Might depend on your sites PR, and whether Google visits often.

We get visited daily, and our front page checked for news etc. If there is a new link or item, then it gets indexed, and appears in Google almost immediately.
This only occurs for first level links from main page.

2nd Level links and deeper only get updated when a deep crawl is done (seems to be every few weeks for us)...

[bcc1234]

huppy99, what is the PR of your main page ?