Forum Moderators: open

Message Too Old, No Replies

Sequence of the update?

what is the sequence of the update?

         

tejas_shah

9:57 pm on Apr 15, 2003 (gmt 0)

10+ Year Member



"anyone seen the deep crawl bot yet ..?"

I thought we were done with the deep crawl and update for this month, and now everything is settled down? I thought the sequence was something like this:

1. deep crawler comes once a month to update its index and it crawls through all the pages on the web, this is called Google dance correct?

2. Freshbot comes often, sometimes number of times a day, depending on the PR and other factors of the site, and it just checks to see if any modifications have been made to the page.

Is there any sequence in which Google dance takes place? For example, 1st freshbot stops visiting your site, 2nd, deep crawler comes 3rd it takes 3-4 days for it to crawl the entire web, etc.

Sorry if this question sounds stupid, but i am learning.

Thank you in advance for all your responses.

TJ

vincevincevince

10:09 pm on Apr 15, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Fresh comes all the time, unless it's reasonably short time before an update (when it would be a waste of time), or just after(ish).

Deep must crawl before it updates, both processes take an age. If you have new content, get it up within the next 12-14 days if you want to be pretty sure it'll hit the next update.

Once deep has been spotted in the wild then we know it's time to do our last minute 24h/7 coding sprees to get stuff finished.

Then come the `dayz of weight` where we feel increasingly nervous waiting for the actual update to see whether our gambles paid off. Between making a mistake, fixing the results it could easily be a month and a half.

That's why we make such a fuss about it.