Page is a not externally linkable
- Google
-- Google SEO News and Discussion
---- Googlebot getting caught in robots.txt spider trap


aakk9999 - 9:05 pm on Aug 3, 2011 (gmt 0)


If it is case sensitive then * should apply as staffa and starchild say their folders have been listed under both. So Googlebot should not have gone in there.


Thread source:: http://www.webmasterworld.com/google/4346138.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com