Page is a not externally linkable
- Google
-- Google SEO News and Discussion
---- Why did GWT stop reporting 404 errors?


indyank - 1:23 pm on Sep 13, 2012 (gmt 0)


The lower section disappeared at the same time that a message about "crawling suspended because robots.txt not accessible" appeared (several months ago). However, robots.txt was and is accessible and Google was and is fetching it, and was and is still also crawling the site!


This again has been going on for more than a year. It would be there and it would be working perfectly but they still report that ridiculous message.


Thread source:: http://www.webmasterworld.com/google/4494524.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com