Page is a not externally linkable
jdMorgan - 5:34 pm on May 2, 2009 (gmt 0)
Apparently, they don't have much in the way of quality assurance checking at the most fundamental protocol levels. I'm not sure how you can build up a good search engine when the critical infrastructure has bugs... :( Jim
They've got other HTTP header problems as well. I note that a particular variant of msnbot/1.1 sends an HTTP From: header reading:
From: If-Modified-Since <appropriate date here>
when fetching pages.