Hey guys, I am getting error in my webmaster tool that- CRAWL POSTPONED BECAUSE ROBOTS.TXT WAS INACCESSIBLE. What does it means? How to remove this. I am seeing that my website is not crawling by google. Please find the attachments and let me have the thoughts
is that a recent message? google will typically show this when the request for robots.txt returns a non-404/410 4XX or a 5XX status code. for example if your server was temporarily down and supplied a 503 Unavailable response.
If you're in Google Webmaster Tools you're most of the way there. It's
:: shuffling papers ::
"Fetch as Google" under the "Health" tab. You can also try "Blocked URLs" on the same tab. This shows you the robots.txt that g is currently using. (They took away the "make a robots.txt" part, but the rest of the page is unchanged.) If there's a robots.txt displayed at all, then you know they are lying in their teeth and they had no trouble finding the file.
Hi please check out my webmaster status. Google fetch I have already done that before. and I don't know about blocked urls. I have a print preview how can I show up the attachments. Also let me know- what to do with :: shuffling papers ::, where I have to put that.