My site has been getting hit by the freshbot daily but I have not been deep crawled. Usulay the deep crawl last 5-10 days. Some people got hit on the 11 March. Can we assume that 3 days is not long enough for Google to crawl the web and that the deep crawl is not over?
o0_cops_0o
2:37 am on Mar 14, 2003 (gmt 0)
The deep crawl is not over, by the sounds of it they havent yet started full force
peterdaly
2:46 am on Mar 14, 2003 (gmt 0)
I had google crawl over 100k pages last month, so far it's gotten only a little over 1000.
Seems slow to me. I got 17 hits in the last hour from the deep crawl. Normally I think it would be doing much more...but who knows.
I'll be nervous in a couple days if it's not slamming me yet.
-Pete
Jesse_Smith
3:03 am on Mar 14, 2003 (gmt 0)
On my sites it's been the most active in the last day or so, and is still active.
MetropolisRobot
4:25 am on Mar 14, 2003 (gmt 0)
It has been tackling my site all day, but I feel that Google has improved the algorithm a bit to make it spider more sites in parellel instead of just one at a time.
