Forum Moderators: martinibuster
http://www.example.com/
- page1.html
- page2.html
- ...http://www.example.com/dir/
- page1.html
- page2.html
- ...
The "Reason Blocked" is Robots.txt File.
I do have "noindex,nofollow" meta tag in http://www.example.com/dir/ page but there is no meta robot tag in both http://www.example.com/page*.html and http://www.example.com/dir/page*.html.
The first two lines of http://www.example.com/robots.txt are
User-agent: Mediapartners-Google*
Disallow:
What's wrong with it? Using this logic all my pages have problems.