- - Search Engines
- -- Sitemaps, Meta Data, and robots.txt
- ---- Googlebot possibly ignoring robots.txt
lucy24 - 10:50 am on Jul 28, 2012 (gmt 0)
You must have missed a few threads :)
Google Preview is a completely separate animal from the ordinary googlebot. It does not even look at robots.txt. Same goes for Google Translate.
Thread source: http://www.webmasterworld.com/robots_txt/4446154.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com