-- Google SEO News and Discussion
---- Matt Cutts asks webmasters: let googlebot crawl js and css
- 2:09 am on Mar 28, 2012
If you are hiding CSS/JS from search engines, you probably have something to hide
Nothing is being hidden - Googlebot is merely being told not to crawl or index the files.
I disallow Googlebot access to images, video and numerous HTML files as well.
Google's other stealth bots - and even their
- still have unfettered access.
And compliance with robots.txt is entirely voluntary anyway.
Brought to you by