- - Google
- -- Google SEO News and Discussion
- ---- Googlebot getting caught in robots.txt spider trap
aakk9999 - 9:05 pm on Aug 3, 2011 (gmt 0)
If it is case sensitive then * should apply as staffa and starchild say their folders have been listed under both. So Googlebot should not have gone in there.
Thread source: http://www.webmasterworld.com/google/4346138.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com