| will google crawl the links at the page with "noarchive, no index"? links, noarchive, noindex |
johnlim

msg:76128 | 5:45 am on Jan 25, 2004 (gmt 0) | Hi, I have a page which don't want google index or archived. Then will google crawl the links at this page? For exapmle, this page is siteA.com/pageA.html and it include the links pageA1.html and pageA2.html, will these two pages pageA1.html and pageA2.html be crawled and archive, indexed by google? (there will not put any <meta name=robots value=noindex> in these two pages pageA1.html and pageA2.html) Thanks, John
|
hotmetal

msg:76129 | 4:49 pm on Jan 25, 2004 (gmt 0) | Yes. A 'nofollow' command would prevent that.
|
nileshkurhade

msg:76130 | 4:50 pm on Jan 25, 2004 (gmt 0) | [robotstxt.org...] [webmasterworld.com...]
|
johnlim

msg:76131 | 12:11 am on Jan 26, 2004 (gmt 0) | But I want google to crawl the links at this page. Only don't want google to index or archive this page. For exapmle, this page is siteA.com/pageA.html and it include the links pageA1.html and pageA2.html, will these two pages pageA1.html and pageA2.html be crawled and archive, indexed by google? (there will not put any <meta name=robots value=noindex> in these two pages pageA1.html and pageA2.html) Thanks, John
|
hotmetal

msg:76132 | 5:33 pm on Jan 26, 2004 (gmt 0) | Yes. A 'nofollow' command would prevent that.
|
BigDave

msg:76133 | 5:42 pm on Jan 26, 2004 (gmt 0) | Google will not index the "noarchive, noindex" page and they will probably follow the links because you did not put in a nofollow. But I would not be too surprised if they gave it a low priority, or if they threw it out before feeding the links to googlebot. There are a lot of hands in that code, and it would be easy to screw it up. So they should follow it, but that doesn't mean that they will.
|
|
|