Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- Server Farms - May 2013
keyplyr - 11:09 pm on Jul 1, 2013 (gmt 0)Thread source:: http://www.webmasterworld.com/search_engine_spiders/4570883.htm
@ dstiles re: ISPpro
Looks like broadband mixed in with web servers (much like Comcast.) Are you pinging for ports to tell the difference or just blocking categorically?
Brought to you by WebmasterWorld: http://www.webmasterworld.com