Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- Yahoo! Slurp China


GaryK - 6:35 pm on Nov 30, 2005 (gmt 0)


It wouldn't surprise me a bit if the decision to use essentially one robot name was intentional. This way we're forced into an all or nothing dilemma. Either accept everything from Slurp or ban everything. Unless you're willing to use more sophisticated means to stop the China bot, and I'd venture a guess that most webmasters aren't able or willing to do that.


Thread source:: http://www.webmasterworld.com/search_engine_spiders/3086.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com