homepage Welcome to WebmasterWorld Guest from 23.22.2.150
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

    
Preventing a page from being indexed but wanting links to be followed
realmaverick

WebmasterWorld Senior Member 5+ Year Member



 
Msg#: 3737889 posted 12:42 am on Sep 4, 2008 (gmt 0)

Hi guys,

I want to use meta robots or robots.txt to stop a number of pages being indexed but I want the links to be followed.

Would <meta name="ROBOTS" content="NOINDEX"> do the trick or would this cause google to start ignoring the pages?

Thanks in advance

 

Marshall

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 3737889 posted 12:44 am on Sep 4, 2008 (gmt 0)

<meta name="robots" content="noindex,follow">

Marshall

g1smd

WebmasterWorld Senior Member g1smd us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 3737889 posted 5:24 pm on Oct 21, 2008 (gmt 0)

The robots.txt file stops listed files from being accessed so the links will never be found.

You need the meta tag. That allows the page to be fetched, links followed, but the content will not be indexed.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved