Page is a not externally linkable
- Google
-- Google SEO News and Discussion
---- Googlebot getting caught in robots.txt spider trap
starchild - 11:42 am on Aug 3, 2011 (gmt 0)
Hi, the IP is 66.249.71.108.
Folder is listed under both:
User-agent: googlebot
and
User-agent: *
Thread source:: http://www.webmasterworld.com/google/4346138.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com