Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- New User Agent for Google News
vincevincevince - 3:53 am on Dec 5, 2009 (gmt 0)Thread source:: http://www.webmasterworld.com/robots_txt/4035489.htm
Publishers, remember not to rely on this user agent to bypass your subscription firewall etc. It is easy for someone to set their browser to use it! Stick to IP lookup methods.
Brought to you by WebmasterWorld: http://www.webmasterworld.com