Page is a not externally linkable
- Google
-- Google SEO News and Discussion
---- Matt Cutts asks webmasters: let googlebot crawl js and css


lucy24 - 4:54 am on Mar 28, 2012 (gmt 0)


with css blocked how are you generating such pretty website previews without ignoring the block?

Pay attention, willya? ;) Preview is not a robot and therefore is not bound by robots.txt. It doesn't even look at it. The only way to keep Preview out of css-- or anything else-- is by physically 403'ing it.


Thread source:: http://www.webmasterworld.com/google/4433745.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com