Msg#: 4485397 posted 9:35 am on Aug 16, 2012 (gmt 0)
For one of my new site i use <meta name='robots' content='noindex,nofollow' /> it was done 30 days before but today when i was searching my sites in google with site: operator for every page in palce of description this message was displayed:
A description for this result is not available because of this site's robots.txt – learn more
Msg#: 4485397 posted 9:45 am on Aug 16, 2012 (gmt 0)
You see it in the index because there are links to the page somewhere or other. Google of course needs to crawl the page in order to even read the robots meta tag, but that tag would prevent them from indexing the content of the page in order to generate a snippet.
However, it also sounds from this message like you have a Disallow rule for those URLs in your robots-txt file - is that the case?
Msg#: 4485397 posted 1:04 pm on Aug 16, 2012 (gmt 0)
@rooo You should remove robots.txt Disallow for co.uk domain if you are also redirecting co.uk domain to .com domain as Google will not be able to see and process the redirect if it is not allowed to request the page.
Once Google processes redirects, the co.uk domain will dissapear from Google (this may take some months depending on the number of pages).