Msg#: 3715911 posted 5:48 pm on Aug 5, 2008 (gmt 0)
I got a message in the Google Webmaster console the other day about a site having too many URLs, encouraging me to look at the URL structure and to robots.txt off duplicate URLs. However, they provided a list of problematic URLs and approximately 60% of the URLs were already robots.txt disallowed. I used the robots.txt analyzer tool in Google Webmaster console to verify that everything was configured right and it is.
Msg#: 3715911 posted 6:40 pm on Aug 5, 2008 (gmt 0)