Msg#: 3349606 posted 12:06 pm on May 25, 2007 (gmt 0)
Our customers link to back to us via the wiget that goes to /members/section. The data on the page is openly accessible but somewhat sensitive, so it has been decided to not let the bots index. Incidentally, the site received a lot of PR from links to these pages.
If I disallow these pages via robots.txt will it result in PR not being passed to the domain?
Msg#: 3349606 posted 3:07 pm on May 27, 2007 (gmt 0)
URLs that are not in the index still receive PR through inbound links. Ogletree's got the right approach - it will allow those URLs to circulate that PR to the pages that they link to, even though their content is kept out of the index.