-- Search Engine Spider and User Agent Identification
---- YahooCacheSystem - what is it?
motorhaven - 2:30 pm on Mar 5, 2012 (gmt 0)
Yes, I've searched on this, but can't find the answer.
Like many others YahooCacheSystem comes in and fetches both the home index and favicon.ico. What I haven't been able to find in discussion here is what this crawler is and does with these. Does anyone know? Block them or not?