Page is a not externally linkable
Samizdata - 2:09 am on Mar 28, 2012 (gmt 0)
If you are hiding CSS/JS from search engines, you probably have something to hide
Nothing is being hidden - Googlebot is merely being told not to crawl or index the files.
I disallow Googlebot access to images, video and numerous HTML files as well.
Google's other stealth bots - and even their humans - still have unfettered access.
And compliance with robots.txt is entirely voluntary anyway.
...