Google has been crawling my sites extensively but quit at about 2:35 AM CST (all sites). Although I've not verified, it is most likely that the bot did not crawl all my pages.
Does anybody else have any evidence of this? Does the bot stop at a scheduled time indenpendent of whether the site crawl is finished?
troels nybo nielsen
8:22 pm on Dec 11, 2002 (gmt 0)
Welcome to Webmasterworld, renee.
It will quite often happen that deepcrawler does not finish a website in one visit. And freshbot can be a very unstable guest.