Forum Moderators: open

Message Too Old, No Replies

Clarification on deep crawl

multiple visits to same pages

         

mfishy

1:54 pm on Mar 20, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Hi,

The deep crawl bot has hit all 9 pages of a site a few different times this month. What does it do with this info?

In other words, will the first visit be reflected in the next update or the last? If the first, what is the purpose of multiple visits?

thx

vitaplease

9:08 am on Mar 25, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I guess they have some double check in place. Either its incorporating last changes or just giving sites second chances if part or complete areas of a site could be down.

Could it also be that you have several inbound external links from good PR pages?

If google starts crawling with the highest PR pages downwards, it could encounter (a) link(s) to your pages several times in its crawling sequences.

Also, I would be suprised if the googlebot is totally efficient. That is once visited by one deepbot, never visited again for that month.