lucy24 - 12:17 am on Mar 15, 2012 (gmt 0)

Maybe if it spent more time reading pages and less time feeding its appetite for robots.txt...

(This can't just be me. I pulled some random pieces of raw logs to re-check. Out of 15 bingbot requests in one batch, 11 were for robots.txt. Elsewhere: 7 of 9
:: sitting on hands ::
3 of 8, 5 of 12. Less than 50% is headline news.)