Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

googlebot not get robots.txt


1:41 am on Jan 14, 2013 (gmt 0)

New User

5+ Year Member

joined:Jan 14, 2013
posts: 1
votes: 0

Hio every one.

In Google Webmaster I display this message
Network unreachable: robots.txt unreachableWe were unable to crawl your Sitemap because we found a robots.txt file at the root of your site but were unable to download it. Please ensure that it is accessible or remove it completely.And the Fetch as Googlebot feature complains it cannot get robots.txt

But robots,txt is ok
but for others search engine site map work very good.

[edited by: incrediBILL at 3:38 am (utc) on Jan 14, 2013]
[edit reason] removed URLs, no specifics please [/edit]

3:43 am on Jan 14, 2013 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member lucy24 is a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month

joined:Apr 9, 2011
votes: 848

But robots,txt is ok

Was that a typo?

This is a more serious question than English speakers may realize. That period on your numeric keypad isn't a physical period, it's a "decimal separator" which may be silently replaced by a physical comma if you've got a non-English operating system. (By weird coincidence I have just this instant come from posting about games. It was a game-registration-code problem that first led me to the decimal-separator explanation.)
11:18 am on Feb 5, 2013 (gmt 0)

New User

joined:Feb 4, 2013
posts: 8
votes: 0

read this article for more help...
7:52 am on Feb 28, 2013 (gmt 0)

New User

5+ Year Member

joined:Jan 17, 2013
votes: 0

Is it really the robots.txt or maybe you placed meta="no index, nofollow" in your website. This happened to my website before they spiders unable to crawl my website too.
1:06 am on Mar 2, 2013 (gmt 0)


WebmasterWorld Administrator phranque is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Aug 10, 2004
votes: 237

welcome to WebmasterWorld, Luka2013!

check your server log files for clues about what happened to the googlebot request.

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members