Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- a legitimate blank?


lucy24 - 9:48 pm on Jun 13, 2011 (gmt 0)


Back with the nameless faviconbot...

Can anyone foresee any ill effects if I make the htaccess say (in English) "block all blank UAs unless they are asking for the favicon"?

Had another one from a google range the other day, but I can't just keep throwing in IP exemptions, because they keep adding more and there will be no end to it.


Thread source:: http://www.webmasterworld.com/search_engine_spiders/4303131.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com