Page is a not externally linkable
lucy24 - 8:35 pm on Oct 9, 2012 (gmt 0)
should I block the javascript in my robots.txt file or shouldn't I block it ?
Wrong question. The question is whether you should block it absolutely-- in config or htaccess-- because Preview, Translate and so on aren't bound by robots.txt.
Are you asking whether google can find the file, or whether they can read it? They can definitely find it; quick detour to raw logs confirms that they occasionally ask for .js files. Presumably for indexing purposes, which means it's time to whip out the
:: shuffling papers ::
<FilesMatch "\.(js|txt|xml)$">
Header set X-Robots-Tag "noindex"
</FilesMatch>