i have visited a site with PR 5 on [domain.com...]
however, it is not cache in google and in its' robots.txt /directory/ is disallowed to visit by robot.
Anyone experience this?
doc_z
9:51 am on Sep 15, 2003 (gmt 0)
The explanation is that links to this page are considered for PR calculation even if the page isn't (or not yet) in the index.
ciml
11:24 am on Sep 15, 2003 (gmt 0)
Also, there's no reason for that URL to rank well for search phrases. /robots.txt exclusion does not ask for a URL not to be listed, only for it not to be fetched.
