Page is a not externally linkable
- Google
-- Google SEO News and Discussion
---- Matt Cutts asks webmasters: let googlebot crawl js and css


Staffa - 10:32 am on Apr 12, 2012 (gmt 0)


Today :
/site.css - 80 - 66.249.72.102 HTTP/1.1 Mozilla/5.0+(compatible;+Googlebot/2.1;++http://www.google.com/bot.html)

That IP number is now put in quarantine, i.e. it gets redirected to robots.txt for a number of visits until it knows what's in it ;o)


Thread source:: http://www.webmasterworld.com/google/4433745.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com