Page is a not externally linkable
- Code, Content, and Presentation
-- JavaScript and AJAX
---- what javascript does google read ?


lucy24 - 8:35 pm on Oct 9, 2012 (gmt 0)


should I block the javascript in my robots.txt file or shouldn't I block it ?

Wrong question. The question is whether you should block it absolutely-- in config or htaccess-- because Preview, Translate and so on aren't bound by robots.txt.

Are you asking whether google can find the file, or whether they can read it? They can definitely find it; quick detour to raw logs confirms that they occasionally ask for .js files. Presumably for indexing purposes, which means it's time to whip out the

:: shuffling papers ::

<FilesMatch "\.(js|txt|xml)$">
Header set X-Robots-Tag "noindex"
</FilesMatch>


Thread source:: http://www.webmasterworld.com/javascript/4505853.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com