Forum Moderators: open
I was unsure which Google forum to post in so I posted here.
In my robots.txt file I have dissallowed root\misc directory (I verified my robot.txt file at SEW and it validated). In this directory are pages that I do not want Google to index. I also use the META no index/follow on those pages. I just found in Googles SERPs every one of these pages. Am I missing something here? How well does the removal page requests work? I noticed on that page this META:
<META NAME="GOOGLEBOT" CONTENT="NOINDEX, NOFOLLOW">
However why would it ignore my robots.txt and the no index/follow META?
Confused,
Brian
Or are you just seeing the url as a link?
Excluding Google with a robots.txt will prevent the page from being returned in a SERP, but it doesn't stop Google from showing your excluded pages to anyone who knows how to ask properly.
Yes I was doing a site:www.****.com and it was listed as just a link. Got it.
Thank you :),
Brian
