Page is a not externally linkable
-- Google SEO News and Discussion
---- X-Robots-Tag - controlling Googlebot via HTTP headers
mikomido - 7:53 pm on Jul 30, 2007 (gmt 0)Thread source:: http://www.webmasterworld.com/google/3407137.htm
Am I right in thinking that this is basically a "Is-robot: true" or "Is-robot: 1" HTTP header? So we no longer have to sniff the User-agent string and guess whether it's a bot or a human using a Web browser?
Brought to you by WebmasterWorld: http://www.webmasterworld.com