Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- goo goo GET GET


lucy24 - 12:12 am on Jan 27, 2013 (gmt 0)


At some point I found an English version of their bot text.

I know the feeling. I once found the English version of the toscrawler's text-- but it definitely wasn't done by clicking a flag icon on the page referenced in their UA :)

They seem to be harmless anyway, so I've added them to the Ignore list.


Thread source:: http://www.webmasterworld.com/search_engine_spiders/4539230.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com