homepage Welcome to WebmasterWorld Guest from 54.211.0.191
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Subscribe to WebmasterWorld

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

    
Preventing a page from being indexed but wanting links to be followed
realmaverick




msg:3737891
 12:42 am on Sep 4, 2008 (gmt 0)

Hi guys,

I want to use meta robots or robots.txt to stop a number of pages being indexed but I want the links to be followed.

Would <meta name="ROBOTS" content="NOINDEX"> do the trick or would this cause google to start ignoring the pages?

Thanks in advance

 

Marshall




msg:3737893
 12:44 am on Sep 4, 2008 (gmt 0)

<meta name="robots" content="noindex,follow">

Marshall

g1smd




msg:3770567
 5:24 pm on Oct 21, 2008 (gmt 0)

The robots.txt file stops listed files from being accessed so the links will never be found.

You need the meta tag. That allows the page to be fetched, links followed, but the content will not be indexed.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved