It seems Google is still deepcrawling. I have noticed botht the fresh bot and the deep crawler this week.
Does this mean that all these new pages will be indexed next month?
griego
1:04 pm on Jan 13, 2003 (gmt 0)
who knows, dude all i know is that i lost my top10 rankings with 3 very popular keyboards in this deep crawl. i really don't know what google is doing. maybe i'll start a new topic.
mfishy someone will surely answer your question.
jamesyap
1:24 pm on Jan 13, 2003 (gmt 0)
From my experience, deep crawl bot will came twice, 1st round it takes all files in your site, 2nd round it take only the root page or maybe some pages that root page link to.
The index after the dance will show the final version it takes.
Grumpus
2:16 pm on Jan 13, 2003 (gmt 0)
Deep crawls seems to have petered out sometime yesterday, by my logs.
G.
hskfun
10:10 pm on Jan 14, 2003 (gmt 0)
googlebot seems to have stopped about 70% of the way through it's normal deep crawl of one of my sites. (petered out on the 12th). Yikes. In my case, that means it missed tens-of-thousands of pages that have been in the index for many months. I'll post again if I see the deep crawl pick up again.