Page is a not externally linkable
- Google
-- Google SEO News and Discussion
---- Googlebot getting caught in robots.txt spider trap


g1smd - 9:00 pm on Sep 4, 2011 (gmt 0)


Google also ignores robots.txt if page has +1 button in it.

See other parallel WebmasterWorld thread.


Thread source:: http://www.webmasterworld.com/google/4346138.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com