Definition Needed: Google "update" versus Google "Deep Crawl"

What's the difference anyway?

[apfinlaw]

OK-I ruined the long weekend watching the "dance"...but our new sites are still not showing up....when doing a search on sitename.com...
however, some of the pages show when doing searches...
the question arises...what is the difference between the dancing and the deep crawling...when should I expect a standard google search to show results from this last update.
sorry, I'm new here....

[jackofalltrades]

Hi Apinflaw, welcome to WW.

Dance: The week long process when Google updates the information in its database.

Deep Crawl: Googles process of collecting information about your website.

The deep crawl happens around the end of the first week in each month, and that information will be reflected in the searches after the dance, at the end of that month.

Also:

Fresh Crawl/Bot: Works on a more frequently basis than the deep crawl and updates within a few days, but the results are kind of guesses and may change after the main dance.

If you are in the database then you should see your site appearing in the results just now.

Hope that helps
JOAT :)

[apfinlaw]

thanks ( a lot!) for the fast reply...
so...if I'm NOT live now..it will be another month or so?

[BigDave]

I don't really like the term "deep crawl". I prefer the term that I have seen GoogleGuy use "main crawl" as it better represents the difference.

The freshbot actually spends most of it's time on my site way down deep, where the content is. I imagine that if your site ranks highly enough, you could end up with your site getting a fresh, "deep crawl" daily.

[BigDave]

When did your site go live and when did you get your first incoming links from established pages?

If it wasn't there for the crawl at the beginning of november, all your pages that show up will most likely be fresh pages.

[apfinlaw]

my sites went live only within the last two weeks...we pointed from established sites we own to the new sites...
what does "fresh" page" imply?

[jackofalltrades]

if your site is being indexed frequently, and you add a new page, or change content on an existing one, then the changes will be reflected within a few days usually, instead of at the end of the month.

As you have only just setup the site, you will have missed the main crawl and its unlikely youll be getting crawled frequently.

Your best bet is to ensure you have a few inbound links in the next week or so - that way your site will be indexed this month and will appear in the search results after the main update.

JOAT

[MOOSBerlin]

BigDave: I don't really like the term "deep crawl".

I like it, today i had at one of my sites 23 deep crawl robots at the same time.