homepage Welcome to WebmasterWorld Guest from 54.167.138.53
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Marketing and Biz Dev / General Search Engine Marketing Issues
Forum Library, Charter, Moderators: mademetop

General Search Engine Marketing Issues Forum

    
Can I boost PR by selectively blocking URL's?
franklin dematto

10+ Year Member



 
Msg#: 2108 posted 4:13 am on Mar 30, 2003 (gmt 0)

I link to several standard pages (privacy, legal, etc) from the bottom of every page. It seems a shame to waste a lot of internal PR on those pages. Can I diver the PR away from those pages, and direct it all to the other internal links, by using robots.txt and blocking the SE's from those pages? Is this a good idea? Will I loose out by doing this?

 

franklin dematto

10+ Year Member



 
Msg#: 2108 posted 4:12 am on Apr 1, 2003 (gmt 0)

Was there something unclear in my question? I'm suprised it hasn't netted any responses - it seems to me to be a great idea.

(Also, the same effect could be achieved by using JS in the url's, or writing the link in JS)

Oaf357

10+ Year Member



 
Msg#: 2108 posted 4:41 am on Apr 1, 2003 (gmt 0)

I'm very interested in answers to this question as well.

marcs

10+ Year Member



 
Msg#: 2108 posted 4:45 am on Apr 1, 2003 (gmt 0)

You could try placing the pages you do not wish to have indexed in a separate directory. Then use your robots.txt file to exclude whichever bots you wish from that directory.

As to PR, the consensus seems to be that the fewer pages you link to from a page, the more PR that page has to offer will be passed on to the pages linked to. IMHO it should do what you want. Someone else may have more input.

franklin dematto

10+ Year Member



 
Msg#: 2108 posted 8:37 pm on Apr 4, 2003 (gmt 0)

I'm really surprised that none of the experts are talking about this. To me it seems like a great idea, allowing you to design your site how you want and still retain full control over PR distribution.

mack

WebmasterWorld Administrator mack us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 2108 posted 9:09 pm on Apr 4, 2003 (gmt 0)

I think you have made a pretty good point. In this situation what I would concider doing is to use JS links to point to your non importaint pages amd use standard links for all home links from within these pages. That was little or no pagerank will be passed across and you will be able to send some extra to places where it is required. In geneal I am not so sure it will make a lot of difference because pagerank will be passed to your pages and back to your homepage so long as you dont have any externl links within these pages. One god reason to use robots.txt to prevent these pages being indexed is due to the fact that pages such as your tos and privacy police may change. It would not be good to have a user read your out of date privacy policy from the google cache.

buckworks

WebmasterWorld Administrator buckworks us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 2108 posted 9:39 pm on Apr 4, 2003 (gmt 0)

I don't think anyone knows if blocking Google with robots.txt or noindex etc. would reallocate the available PR to the other pages being linked to. Even if it can't go any further, Google can still see the link(s).

A certain way to hide "housekeeping links" from spiders would be to place them in an external .js file. This might also help your page load speeds a bit because the same .js file could be called from cache as a visitor moved around your site. There would need to be alternate access so visitors with javascript turned off could still get to those pages. A set of ordinary links on the home page would do the trick.

Another approach could be to link liberally to the housekeeping pages so they DO collect PR, then link from them to selected pages where you want extra PR to flow. That would avoid the complications of javascript.

A final thought: when you're seeking link exchanges, check whether a link from one of the other site's houskeeping pages might be advantageous. Example: Something simple like "We're proud to be listed in blahblah.com" on their About Us page might be surprisingly beneficial PR-wise, depending on how their site is structured.

franklin dematto

10+ Year Member



 
Msg#: 2108 posted 2:41 am on Apr 6, 2003 (gmt 0)

I don't think anyone knows if blocking Google with robots.txt or noindex etc. would reallocate the available PR to the other pages being linked to.

AFAIK, Google's PR is a distribution function across the entire Internet, with the sum of PR of all pages = 1. I assumed that it was across all the pages that they index - I think this is a reasonable assumption. Can anyone confirm or deny this?

Another approach could be to link liberally to the housekeeping pages so they DO collect PR, then link from them to selected pages where you want extra PR to flow. That would avoid the complications of javascript.

This raises a good point. How much PR is passed on every generation? In other words, if a link from A is worth PR x, and A links to B, and B links only to C, how much PR will C gain? I'd be sure it is less than x, but maybe I am wrong.

buckworks

WebmasterWorld Administrator buckworks us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 2108 posted 3:48 am on Apr 6, 2003 (gmt 0)

<<I assumed that it was across all the pages that they index - I think this is a reasonable assumption.>>

<speculation> I think that's the theory but I'm not sure how it would work in real life when some pages are blocked. I think it would be a fair bit of extra info to track if Google could see, say, 15 links on a page but one of those pages wasn't supposed to be indexed. Depending on how the blocking was done, Google would not know not to index the page until it had followed the link. Would it back up and reallocate the PR or would it just keep going? Would each link be given 1/14th of the available page rank or would 14 pages each get 1/15th and the remaining 1/15th which would have gone to the blocked page would just fizzle out or something? </speculation>

We might be able to get some clues to this if someone had any examples of "blocked" pages with some strong links pointing to them. Would such a page show PR if you visited it?

I've seen cases where it seems as though Google is listing pages that it hasn't actually indexed yet, on the strength of their links. I'm wondering if there's a parallel here. A non-indexable page should not show up in the SERPs, but if you went directly there, would it show a PR on the strength of its links? Hmmm ...

I'm sure you're right that there would be some PR shrinkage when A links to B links to C links to D ... even if they each had only the one link. That would be the "damping factor" at work.

Spannerworks

10+ Year Member



 
Msg#: 2108 posted 9:14 pm on Apr 7, 2003 (gmt 0)

Blocking the page does not prevent the PR goint to that page. You would have to block the pages linking to the page, to stop it getting any PR.

An external JS would prevent Google from recognising the link. So that would stop the PR to that page.

But I agree with Mack, as long as there are no external links on the page PR will be preserved and linking to the privacy, legal, etc isn't a big issue

franklin dematto

10+ Year Member



 
Msg#: 2108 posted 2:39 am on Apr 8, 2003 (gmt 0)

Spanner, I'd like to know your sources for all of this.

SEO practioner

10+ Year Member



 
Msg#: 2108 posted 2:14 am on Apr 14, 2003 (gmt 0)

Personally, I think that PR flow is just that: PR flow. I think it's better to let it flow freely from one page of your site to another, as long as your not creating any spam and as long as your not doing anything illegal in the SE's books.

But that's just me. If some of your housekeeping files help distribute some PR in a site, I don't see what wrong with that. Most sites people develop on the web are all interlinked to their housekeeping files such as TOS and privacy agreement, etc.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Marketing and Biz Dev / General Search Engine Marketing Issues
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved