Forum Moderators: goodroi

Message Too Old, No Replies

What the dilly?

         

tonynoriega

3:10 am on Jul 17, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



My google sitemaps account says it cannot access my main site? index page?

www.mydomain.com is unreachable?

here is my robots.txt file

User-agent: *
Disallow: /addons/
Disallow: /include/
Disallow: /install-/
Disallow: /newsletter/
Disallow: /NHMweb/

goodroi

12:22 pm on Jul 17, 2007 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



Possibility #1
Is that your entire robots.txt file? Google will ignore general instructions if you include specific googlebot instructions.

Possibility #2
Are you blocking Google using htaccess?

Possibility #3
Do you have multiple robots.txt files. Sometimes hosting companies do not allow you your own robots.txt file and will overwrite with their version.

Possibility #4
Did you upload the robots.txt file to the root? Search engines will look for the robots.txt file in the root directory. Maybe you have an old version that is blocking google still in the root directory.

Possibility #5
Do you have robots meta tag on your homepage? You may be allowing your pages in robots.txt but then blocking it with the metatag.

Possibility #6
Was your site down? If your site was broken or ran out of bandwidth than Google cant access it.

Possibility #7
Did you recently break up with your girlfriend who just so happens to personally know someone in Google Sitemaps? Never mess with an angry woman.

Ok it probably is not #7. Hopefully it was one of the other six. To give a more focused answer we'll need more information from you. Good luck.

cheers
greg

Achernar

5:39 pm on Jul 18, 2007 (gmt 0)

10+ Year Member Top Contributors Of The Month



This is a network problem. googlebot was unable to connect to your server. robots.txt errors are presented differently.
Example: " We can't currently access your home page because of a robots.txt restriction."