|If you use both a robots.txt file and robots meta tags |
If the robots.txt and meta tag instructions for a page conflict, Googlebot follows the most restrictive. More specifically:
•If you block a page with robots.txt, Googlebot will never crawl the page and will never read any meta tags on the page.
•If you allow a page with robots.txt but block it from being indexed using a meta tag, Googlebot will access the page, read the meta tag, and subsequently not index it.