Why is it that googlebots visits to pages are in a very strange pattern, if in a pattern at all - i would have thought that a bots best bet of crawling all the pages on a site would be a get to a page, and systematicly follow all the links from top to bottom, excluding ones it has already been to - but wow - looking at my logs i see that the little fella is jumping about the site like a crazed being, shifted between sections, sometimes bottom link, sometimes top, sometimes none at all...why does it behave like this - it makes me wonder how much it may be missing out...
