When Google is allocating PR across outcoming links (including internal) does it count for those to pages disallowed in robots.txt (and not crawled)? For example. I have a page, say with 10 internal outcoming links only. If I disallow in robots.txt the pages linked by 5 out of these 10 links would this mean that pages linked by remaining 5 links will get greater PR?
Tyler
hakre
3:12 am on Jan 9, 2003 (gmt 0)
i think they get the only PR. the others are ignored.
ciml
1:06 pm on Jan 11, 2003 (gmt 0)
If 5 of the 10 links are /robots.txt protected, then the other 5 only get 1/10 of the page's PageRank each (minus decay factor). The /robots.txt protected URLs can be listed by Google.
If the other 5 give "404 not foud" headers instead of being /robots.txt, then they won't be listed but the other 5 still only get 1/10 of the page's PageRank each (minus decay factor).
