Welcome to WebmasterWorld Guest from 54.162.136.26

Forum Moderators: goodroi

Message Too Old, No Replies

how to let robot crawl the links at a page but not index this page?

index, robot

     
12:13 am on Jan 26, 2004 (gmt 0)

Junior Member

10+ Year Member

joined:Dec 22, 2003
posts:90
votes: 0


But I want google to crawl the links at this page. Only don't want google to index or archive this page.

For exapmle, this page is siteA.com/pageA.html and it include the links pageA1.html and pageA2.html, will these two pages pageA1.html and pageA2.html be crawled and archive, indexed by google?

(there will not put any <meta name=robots value=noindex> in these two pages pageA1.html and pageA2.html)

Thanks,

11:39 pm on Jan 26, 2004 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Dec 5, 2002
posts:1562
votes: 0


"noindex,follow" should be what you're looking for
[robotstxt.org...]
 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members