Forum Moderators: open

Message Too Old, No Replies

Googlebot Continuous Crawling of Certain Pages

Is this associated with the crawling of backlinks?

         

fathom

7:07 am on Sep 5, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Googlebot has been doing a deep crawl for days, but in addition to crawling changes, new pages, and complete sub-directories, it has been continously crawling about 50 pages over and over again and in a few cases 40+ times in the last 3 days.

Many of these are the primary landing page for sub-directories but not all.

Is this possibly a sign of adding new backlinks or something else?

martin

9:44 am on Sep 5, 2002 (gmt 0)

10+ Year Member



It's possibly related to the fresh tag.

It crawls only my root more than once for an index.

lazerzubb

9:48 am on Sep 5, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Probably have to do with Google Everflux [webmasterworld.com]