Forum Moderators: open
How does robots.txt affect Page Rank?
If you ask Google not to index a page, does Google treat the page as if it were there, or not there? Could greater discipline with robots.txt--making sure that only content-rich non-dead-end pages are indexed--allow PR to pass more smoothly throughout the site?
I think the question is theoretically interesting, but I've also been ignoring robots.txt--I never get any traffic on my unimportant, dead-end pages anyway. I wonder if I should get on the ball, and give Google a smoother path.
