| Preventing a page from being indexed but wanting links to be followed
|
realmaverick
msg:3737891 | 12:42 am on Sep 4, 2008 (gmt 0) |
Hi guys, I want to use meta robots or robots.txt to stop a number of pages being indexed but I want the links to be followed. Would <meta name="ROBOTS" content="NOINDEX"> do the trick or would this cause google to start ignoring the pages? Thanks in advance
|
Marshall
msg:3737893 | 12:44 am on Sep 4, 2008 (gmt 0) |
<meta name="robots" content="noindex,follow"> Marshall
|
g1smd
msg:3770567 | 5:24 pm on Oct 21, 2008 (gmt 0) |
The robots.txt file stops listed files from being accessed so the links will never be found. You need the meta tag. That allows the page to be fetched, links followed, but the content will not be indexed.
|
|
|
