Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- YahooCacheSystem - what is it?
motorhaven - 8:35 pm on Mar 5, 2012 (gmt 0)Thread source:: http://www.webmasterworld.com/search_engine_spiders/4425062.htm
Thank you! That is exactly the information I was looking for. I've seen many prominent members here say they block it, but never an in depth reason why.
Brought to you by WebmasterWorld: http://www.webmasterworld.com