robots.txt blocking my index page?

Hello

[hola2]

I have a problem with robots.txt.

In the webmaster tools appear a lot of URLs as blocked in robots.txt.

But when I go to validate the robots.txt, all is OK, and that URLs are correct and not blocked in robots.txt. The PR of the index page was 4, and now hasn't any PR, but the forums has 3 PR, and that URLS appear in google results.

So, the main problem is the index page (main page) is blocked (google says in robots.txt), but isn't really blocked in robots.txt, when I see it, and test with webmaster tools of google, the tool says they have correct access.

Please, any idea about this?

Thanks in advance, and sorry for my english.

[goodroi]

hi hola2,

Welcome to WebmasterWorld! I am a little confused by your message. I assume you are using Google Robots.txt Validator to test your robots.txt file. Did you use any other validator? You also said that your index page is blocked. Does this mean when you look in Google's search index it does not appear?

thanks,
greg

[hola2]

thanks for your answer. I'll try to explain it a bit more.

Until January 15th, the index page was ok, and the dir /forums too. Both appears in the google index, and the google webmaster tools said it was ok, and every 2 days appear the googlebot had visited the index. But from January 15th, the index page has dissapear from google, and the google webmaster tools said the robots.txt is blocking the news in the index:

www.example.com
www.example.com/article1700.html

And the pagerank has dropped in that index from 4 to none.

I`ve validated the robots.txt in other validators, and it was the same as when google indexed correctly that articles. If I put that URL in google validator it says the access is correct.

www.example.com/article1700.html Allowed

I've tried to put an Allow lines to googlebot without any positive results.

When I`ve put that Allow lines, the google robots.txt validator says:

www.example.com/article1700.html Allowed by line 20 of robots.txt

But on the other hand the forums: www.example.com/foros has the PR3, with no variation from a year ago.

Please, any recommendation?

Thanks
[sorry no urls please]

[edited by: goodroi at 1:55 pm (utc) on Feb. 2, 2007]

[goodroi]

This does not appear to be an issue with your robots.txt file. Your robots.txt file is not blocking any search engines from getting to your pages. The issue is something else.

I tried to visit your website and had some connection issues. It might be that I experienced a temporary issue or it might be that your hosting is having problems.