Forum Moderators: open
Why does Google display this page in its results, have I done something wrong???
Thanks
DIV
P.S. Yes there is more code to this page than this :-)
keep <meta name="robots" content="noindex,follow"> and drop
<meta name="robots" content="noarchive">
Incidentally <meta name="MSSmartTagsPreventParsing" content="true"> is a non relevant tag. Microsoft dropped this from XP, lawsuites were pending.
<added> now that I think about it - this depends on what you want the bot to do. "noarchive" means list but don't cache a page.
Well what I would like it to do :-) is ;
read the page and follow the links on it
but not to place it in the search results
and not archive either.
Thanks
Div
the bot can't cache what it can't index.
Sorry I also have pages that I wish google to index, follow and not archive what should i do about them?
Thanks
Again
Div
Googlebot will obey both and other bots will use just the robot tag.
Also note most search engines do not have "noarchive"
Can't find the info - I need anywhere
<meta name="robots" content="noindex,follow,noarchive">
<meta name="robots" content="index,follow,noarchive">
Are they universally acceptable to all search engines????
Using the tags in the postings above Google has indexed pages which have the noindex tag.
Please help it is driving me mad :-(
Thanks
Div
<meta name="robots" content="index,follow">
<meta name="robots" content="noindex,follow">
<meta name="robots" content="index,nofollow">
<meta name="robots" content="noindex,nofollow">
<meta name="robots" content="all">
<meta name="robots" content="none">
Many search engines have a tag specifically for there bot like googlebot
<META NAME="GOOGLEBOT" CONTENT="NOARCHIVE">
If Google has indexed a page you do not want indexed add to the robot.txt, googlebot will read this once a day or each time it comes around.
