thetrasher - 9:00 pm on Dec 28, 2007 (gmt 0) Seems to be a quality check. Over and over again.
Yes and no. Slurp/3.0 asks for non-HTML files (even imported CSS) with correct referrers, just like a Gecko browser. But I can't confirm a violation of robots.txt (nothing disallowed here).
Has anyone else seen this behaviour?
Seems to be a quality check. Over and over again.