Page is a not externally linkable
- Google
-- Google SEO News and Discussion
---- X-Robots-Tag - controlling Googlebot via HTTP headers


Key_Master - 9:00 pm on Jul 31, 2007 (gmt 0)


Here's a simple example for Apache that you can include in your .htaccess file to keep Googlebot (and hopefully others in time) from indexing image files. With some modification it can be used to control robot access to other files or file types:

<Files ~ "\.(gif¦jp[eg]¦png)$">
Header append X-Robots-Tag "noindex"
</Files>

The X-Robots-Tag directive is a small step towards making robots.txt obsolete.


Thread source:: http://www.webmasterworld.com/google/3407137.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com