Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
GaryK - 11:49 pm on Nov 5, 2008 (gmt 0)Thread source:: http://www.webmasterworld.com/search_engine_spiders/3768838.htm
One of the things I like about IIS is the ability to block an IP Address or range across all domains. Surely there's a way to do that with Apache.
Brought to you by WebmasterWorld: http://www.webmasterworld.com