Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- FollowSite dot com


wilderness - 6:32 pm on Feb 2, 2009 (gmt 0)


The MSIE Browser will do this on their own (which some webmasters have denied because it's a real PITA).

One one version the setting for IE to constantly reccheck saved pages and bookmarks for updated pages, was the default setting.

Thus is MSIE will do this (and the majority of the WWW uses IE), why go the trouble of inserting text into your active pages for another website to service its customers (unless they are giving you a commission on their fees?)

Falls under "3rd party category" for denial. IMO.


Thread source:: http://www.webmasterworld.com/search_engine_spiders/3839959.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com