- - Google
- -- Google SEO News and Discussion
- ---- Google cached my robots.txt file
atlrus - 12:10 am on Jan 30, 2007 (gmt 0)
|Google does index text files you know. |
I didn't think Google looks at robots.txt as just a text file - Google always looks for robots.txt and if what you say it's true - everyone's robots.txt would have been cached.
Thread source: http://www.webmasterworld.com/google/3234479.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com