Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- Best method of blocking?
slipkid - 7:02 pm on Sep 4, 2013 (gmt 0)Thread source:: http://www.webmasterworld.com/search_engine_spiders/4605790.htm
I note that your class A blocks reference 209 which includes the Google IP span 22.214.171.124 - 126.96.36.199.
Was this intended? If so, why?
Brought to you by WebmasterWorld: http://www.webmasterworld.com