Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- U of Cal


dstiles - 10:48 pm on Feb 3, 2013 (gmt 0)


I have the complete range 192.35.222.0/24 blocked as being a pain. Odd for a US uni to have only a /24 anyway.

I have no problem with letting unis in general access sites so long as they seem genuine visitors. Persistent bot sub-ranges get blocked.


Thread source:: http://www.webmasterworld.com/search_engine_spiders/4541980.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com