Forum Moderators: open

Message Too Old, No Replies

Googlebot visits! But does not index

Gbot looks at pages that are not in the index yet.

         

derekwit

1:53 am on Apr 11, 2003 (gmt 0)

10+ Year Member



I had my entire site crawled earlier this month. I hope to get some pages listed after the next dance. But my question is why does Googlebot come by and refresh pages that are not yet in the index. And why does he not pick up my home pages which usually gets fresh tags but has not for the last 5 days.

Brett_Tabke

10:20 am on Apr 11, 2003 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



It is near impossible to say. The different spidering routines of the last six months have not yeilded much of a pattern to freshbot. It seems to act is mysterious ways with new pages. That means, they are changing the system, fixing problems, or adding features.