| Welcome to WebmasterWorld Guest from 18.104.22.168 |
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
|Become a Pro Member|
I have noindex,follow but the page is indexed
I have a complete sitemap in my root directory that I'd rather not have indexed, as there is a more user friendly, but not search engine friendly, navigation tool that I have in place.
I put in the header of my sitemap:
<meta name="robots" content="noindex,follow">
I just looked at big G, and they indexed this page. Is my syntax off? Is there another way to accomplish this through robots.txt?
skip the "follow" part. If "nofollow" isn't present, then the bot keeps a going. (besides, we pretty much know that G doesn't obey "nofollow" anyway).
All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved