Page is a not externally linkable
keyplyr - 10:16 am on Sep 19, 2009 (gmt 0)
Hit each page on a 150 page site twice in succession, response code 200 for all. 1st time the size of file is normal. The second time it looks like the file size of the html plus the images. So I'm assuming msnbot/2 is taking snapshots. Anyone else verify this?
verified rDNS, normal crawl range.