lucy24 - 1:38 am on Jun 9, 2012 (gmt 0)
I had one visitor today spending 45 minutes looking at all my NEW products, 45 pages worth of stuff. I can't believe anyone would do that, unless they are spending time in a federal prison and have nothing better to do. Maybe a teenager in detention.
Was each page load accompanied by instant loading of all adjunct files such as images and css, including a single load of the favicon? Paradoxically, some types of loads happen faster with humans: pages will come at least a few seconds apart, but images load up as fast as your server can dish 'em out. Robots otoh go through at a steady pace. If they get images/css/js at all, they will load with the same time interval as pages.
Unfortunately, you can only tell this after the fact, because either way, the page comes first.
If all you care about is US and Canada, you can pretty well go by IANA /8 blocks.
:: shuffling papers ::
minus about half of that list for internal corporate IPs, and then there's the vexing problem of Early Registrations (most of the 128-172 range) which could be anywhere. Conversely, there's your Brits and Australians and so on, who are scattered throughout RIPE and APNIC. If you personally know someone at 202 or 203 it's all over, because that's the realm of /24 country blocks.
And then you have to start all over again with the 6-piece blocks...