Google deep Crawl...how long does it take to appear in the results?

how long does it take to show up in Google result pages from the deep crawl

[bobosse]

Hi guys

First of all, I have to admire the knowledge that some of you have on the overall functionality of Google...incredible!

I am pretty much new to all that, but I have learnt a lot reading many posts.

One thing is still unclear for me.

I have created a brand new site, and submitted to Google a month ago. Last week, on the 3rd, 4th and 5th of July 2003, Google came on my site.
My idea of this was that Google would actually look at unique files like mydomain.com/something.html but in my reports it shows that Google looked at my robots.txt file a few times.

So first: is this okay? Will Google come back to look at my multiple page URLs?

And second: how long should it take for my site to show up in Google? A week, a month or more?

I thank you all in advance for sharing your experience with this.

Bobosse

[GoogleGuy]

JoeHouse, we generally pick up index pages pretty quickly. It's kinda like a curve over time. As time goes by and more people link to your site, Googlebot tends to delve deeper too.

AhmedF, you asked "When/why is there no cache to be shown for a page?" That can happen when we saw a link to your page, but haven't gotten to crawl the actual page itself yet. Usually with more time or with more people finding/linking to your site, we'll go deeper with crawling for a site.

Fearless, as far as php pages and jump menus, the file type of the page (php, asp, cgi, etc.) doesn't matter. If your jump menus are JavaScript or the links are buried in some esoteric way, our regular crawler might not be able to pull those links out. When in doubt, a nice site map can improve sites for users and crawlers.

Hope that helps..
GoogleGuy

[g1smd]

>> If your jump menus are JavaScript or the links are buried in some esoteric way, our regular crawler might not be able to pull those links out. <<

Umm, thinks out loud: ... our regular crawler ...

Does that mean that there is some other crawler that goes round as well, or is about to?

and ... might not be able to ...

Does that mean that it might be able to follow some javascript etc?

Just thinking aloud.

[midnightcoder]

Is there a max number of pages that Google will index in one site. I'm not talking about Amazon etc, just talking about a regular run of the mill site with a pr 4 or 5.

[Fearless]

Googleguy,

Thanks for jumping in!
No, what I meant was, does the crawler catch links to my site that are jump menus, php or asp?

As I said, more and more of the sites who link to us are done that way.

Is that different from "people who find you" (as you expressed it above.) Does traffic play a role somehow in when a crawler indexes the rest of the pages on our site? Right now, just the index page is listed via manual submission.

(Oh, and I did put in a site map- root level, plain jane HTML links.)

[edited by: Fearless at 12:43 am (utc) on July 14, 2003]

[markus007]

Google guy, i've noticed some backlinks cache's are vanishing and all that shows up when looking at backlinks is a "link". No description and no cache.