Forum Moderators: Robert Charlton & goodroi

Message Too Old, No Replies

Problem with Google bots unable to access my site

         

Ironside

3:22 pm on Mar 8, 2014 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



I am occasionally getting a message telling me that Google bot cannot access my site. I vaguely remember making some alterations to 18 months ago because my site was very slow and I thought that maybe the bots were slowing things down. However, for the life of me I cannot find out where I can make alterations to this. I'm in Webmaster and under the menu, there is Crawl, but I still have a problem because basically I'm not sure what I'm supposed to do.

This is a message I received

Over the last 24 hours, Googlebot encountered 184 errors while attempting to connect to your site. Your site's overall connection failure rate is 2.6%.

mack

5:46 pm on Mar 8, 2014 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



Did you perhaps alter your robots.txt file on your website. This is a file used to restrict certain bots or all bots from being able to access your site, or parts of your site.

Mack.

mack

5:48 pm on Mar 8, 2014 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



Added: if you made the changes such a long time ago, I would have suspected you would have had issues before now. It is possible you had an intermittent hosting outage, or a DNS issue.

Mack.

Ironside

10:30 pm on Mar 8, 2014 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Mack, you are pretty much spot on. Quite a few months ago, maybe even over a year ago my website Going down, it was driving me mad. It seems that I had a lot of bots hitting my site. Anyway, I remember restricting Google bots at the time. I wish I'd taken a bit more notice, I think it may have been the case that the changes only lasted for a couple of months and then changed back to the original setting, I really can't remember. However, I've not had any problems with my website dropping in rank, or dropping in listings on Google so that can't be too much wrong.In fact, I'm earning more money through Google AdSense at the moment than I ever have done. Some probably a little bit reluctant to mess around with settings anyway.

tangor

10:34 pm on Mar 8, 2014 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Sounds like a traffic load on the host server. Connections are occasionally intermittent. The only way to correct this is to move to a more robust host.