Page is a not externally linkable
-- Google SEO News and Discussion
---- Matt Cutts asks webmasters: let googlebot crawl js and css
tedster - 10:27 pm on Apr 9, 2012 (gmt 0)Thread source:: http://www.webmasterworld.com/google/4433745.htm
|Disallowing files in robots.txt is a request not to index them. |
As I understand things, Disallow is a request for the named bot not to CRAWL the file.
Brought to you by WebmasterWorld: http://www.webmasterworld.com