- Search Engines
-- Search Engine Spider and User Agent Identification
---- Yahoo now violating robots.txt
- 3:20 am on Dec 31, 2007
I've added Slurp/3.0 to denies and will thus see how it effects my listings and other crawls - wilderness
You're a better man than I Gunga Din.
Brought to you by