-- Search Engine Spider and User Agent Identification
---- Yahoo! Slurp
Pfui - 12:12 am on Dec 8, 2011 (gmt 0)
I started this thread because Yahoo was bot-running two versions of Slurp and one of them, Slurp/3.0, was reading and flat-out ignoring long-standing robots.txt Disallows for graphics, file types, directories, whathaveyous. Still is.