Page is a not externally linkable
tigertom - 11:53 pm on Jan 18, 2007 (gmt 0)
Read it on a site while I was researching robots.txt tutorials. And no, I can't remember the site name.
The reason is probably that MSN got complaints from webmasters about the MSNbot being too greedy. So now it's very tentative with its spidering.