lucy24 - 4:31 am on Mar 6, 2012 (gmt 0)
Always from 184.108.40.206n. UA always a bare "YahooCacheSystem". Have never asked for anything but front page plus favicon. Now that they're getting 403'd they no longer ask for the favicon-- which is kinda funny, since I let everyone have that. The front page changes about once every six months. (I am not a front-driven site.) D'you suppose they assume that all other pages change even less often?
Far as I know, they have never ever even once asked for robots.txt. Well, maybe back in 2007 when I wasn't paying attention.