Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- What's the Best Way to Keep All Spiders/Bots Out?
inbound - 8:29 pm on Oct 2, 2011 (gmt 0)Thread source:: http://www.webmasterworld.com/search_engine_spiders/4369764.htm
Wilderness, thanks for tking the time to explain all that. The more I look into this, the more of a minefield it appears to be.
Brought to you by WebmasterWorld: http://www.webmasterworld.com