Page is a not externally linkable
- Google
-- Google SEO News and Discussion
---- Googlebot getting caught in robots.txt spider trap


Staffa - 9:35 pm on Aug 3, 2011 (gmt 0)


Actually, in my robots.txt it's : Googlebot
as copied from the UA, which I always do to be sure to have the spelling right.

(I just copied those lines from the post above)


Thread source:: http://www.webmasterworld.com/google/4346138.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com