Forum Moderators: open

Message Too Old, No Replies

101K Page-How Deep does DEEP Crawl Go?

The links aren't in cache-did DeepBot stop?

         

Traveler

4:30 pm on Apr 30, 2003 (gmt 0)

10+ Year Member



We have some sites that WERE at 120k for home pages. (Now- as of today- at 85k)
On the View Cached version, only the "top" part of the page is displaying-ALL of our footer text links have disappeared.

My question is:
Is this representative of what the DeepCrawl would have found. Did we "lose our links" that were at the bottom of our sites?
Is this a freshbot issue, or also a deepbot issue?

ANy help appreciated...losing sleep over this one.

takagi

4:38 pm on Apr 30, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Usually the cache contains the information that was collected by deepbot. The data after the first 101k is ignored by Google. So all text (i.e. keywords), links etc after the limit won't help for the SERP (Search Engine Results Page). If freshbot visits the revised/shortened page and finds links to unknown pages, then these pages could be visited by freshbot. It is unlikely that the cache will be updated when freshbot visits the page.