Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- Updating bot ban list & cleaning out obsolete entries
KenB - 3:03 am on Dec 22, 2009 (gmt 0)
No I hadn't seen that thread, I'll chew on it while searching logs one bot name at a time.
Thread source:: http://www.webmasterworld.com/search_engine_spiders/4046696.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com