Page is a not externally linkable
- Google
-- Google SEO News and Discussion
---- Matt Cutts asks webmasters: let googlebot crawl js and css

tedster - 10:27 pm on Apr 9, 2012 (gmt 0)


Disallowing files in robots.txt is a request not to index them.

As I understand things, Disallow is a request for the named bot not to CRAWL the file.

Thread source:: http://www.webmasterworld.com/google/4433745.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com