Forum Moderators: Robert Charlton & goodroi
Would it help the PR distribution throughout the rest of the website if we stopped Google from going to this page? Would it be best to do this by added a rel nofollow tag to all the links to this page? I've been searching WW threads all afternoon and it seems like there are a lot of conflicting opinions about if it is OK to do nofollow on your internal non-important links. Thanks for any advice.
# /robots.txt file for http://www.example.com/
User-agent: *
Disallow: /copyright.html
Disallow: /contact.html
That is the best way for links on footers, headers, leftnav, etc., IMHO, rather than the "nofollow" tags for those.
you're basically telling the search engine that one of the pages on your site contains unuseful content.
A lot of theories out there support the idea that a given PR site can only hold so many pages in the main index, the rest with lowest PR go supplemental. So, if you robots.txt out a page does the credit for that page go towards another page? That's a good question, for that reason I do both, nofollow links to and robots.txt out pages you don't want indexed (contact us, return policy, shipping, etc)
you're basically telling the search engine that one of the pages on your site contains unuseful content.
But maybe one of your pages doesn't contain content that's useful to a searcher. If that's the case, why wouldn't the search engine's designers be grateful that you've helped them out with a "nofollow"?
A page that is blocked by robots.txt will indeed still gain PageRank even if it's never been crawled by Google since its inception as long as there is a link there.
It doesn't matter what the content of the page is in regards to PR, therefore, I page does not need to be spidered to gain PR.
It's been a while, but I used to see pages at the top of the results that had never been spidered and were there purely on inbound links to that particular page (I also seem to remember some threads a ways back about URLs found in a robots.txt file still ranking even without the title, snippet, etc. because of the inbound links).
Instead of trying to block PR from flowing to copyright pages, privacy pages, and so on, ponder how you could harness the PR flowing FROM such pages.
Those pages can be a useful place to add links that are different from your site's normal navigation system, as a way to funnel some extra link juice to strategic internal pages.
If you had some internal pages that were starting to pull traffic for long-tail searches you didn't expect, they'd be ideal for such treatment.
Those pages can be a useful place to add links that are different from your site's normal navigation system, as a way to funnel some extra link juice to strategic internal pages.
My belief is that this strategy is not helping since the last pagerank update. I am not very sure but it seems true atleast for my sites. I guess footer links pr passing value is decreased!
They should be, and at one time they were assets. And they still could be now *if* it weren't for how PR is being rationed and distributed within sites with lower PR, say in the PR3-PR4 range, and the ratio of pages making it into the primary index vs. being relegated to the supplemental index (and not showing TBPR).
[edited by: Marcia at 8:32 am (utc) on July 19, 2007]
But maybe one of your pages doesn't contain content that's useful to a searcher. If that's the case, why wouldn't the search engine's designers be grateful that you've helped them out with a "nofollow"?
If those designers were really smart - and I believe they are - they are already internally excluding copyright/sitemap type pages in the algo PR.
I would never use nofollow on an internal link. Heck, I wouldn't use nofollow on an external link! Let the SEs sort their self created crap (citation reliance) themselves.
1) disallow page in robots.txt
2) noindex meta tag on the page
3) rel="nofollow" for all links leading to the page.
Its' OK to have all of them, just don't forget you have it when yu
decide to remove restrictions.
nooooooooooo just use disallow robots.txt OR noindex meta tag
Please, please, do not make your site sterile or Googlebot will hate youc
You need privacy pages, you need disclaimer pages, you need FAQ, all these thing make your site professional, so please index these pagesc.
And kill file rel=hnofollowh
Slowing down indexing overall in some situations.
Sending a signal to Google that indeed you are a 'knowledgeable person' in terms of SEO
Possibly removing trust signal pages.
If chanelling pr is really a concern for you, then take stock of the hierarchy of the website, pull out a pen and pencil or schematics tool and draw up a better internal linking structure for your website.
Would it help the PR distribution... [using] rel nofollow tag to all the links to this page?
Most ignored buckworks' idea:
"Instead of trying to block PR from flowing to copyright pages, privacy pages, and so on, ponder how you could harness the PR flowing FROM such pages.
Those pages can be a useful place to add links that are different from your site's normal navigation system, as a way to funnel some extra link juice to strategic internal pages."
[matrix_neo] belief is that this strategy is not helping since the last pagerank update.... footer links pr passing value is decreased!Buckworks did not speak of the footer links. He suggested adding IBL to the text part of these "unimportant" pages.
Until Big Daddy.
There are certain things that worked fine until the infrastructure change and a little while before, when certain changes started to show up regarding how sites are crawled and indexed; but things aren't the same any more. Using certain pages to funnel PR may work if there's enough PR to go around the site, or at least the more important pages, which is not always the case.
When 2 and 3 year old newsletter pages, which are not getting link love either from within the site or from other sites, and even very minor, far less important product pages have PR and important money pages are PR0 in the Supplemental index, it's time to make changes to the navigation and start separating the wheat from the chaff, and to start making prolific use of robots.txt and the robots meta tag.
[edited by: Marcia at 3:36 am (utc) on July 20, 2007]
Like Marcia recommended it maybe necessary to disallow pages that are leaking PR in robots.txt and you may even need to change the menu structure not to include links to such pages.
I am currently disallowing affiliate content pages for categories. I am thinking of getting the links out of the menu as well.
So maybe have one link to a page that will have all the links to each category instead of having all the category links in a template menu that are shown on every page.
I am probably losing out on rich keyword phrases becauses they are being duplicated across all the pages that are indexed in the main Google index.
Anyway I got read of almost all supplementary pages and search engine hits improved 500 percent.
So I am being served good by Googlebot now, will wait a bit before redesigning the menu, do not want to make too many changes at one time...Googlebot may not like it.