Forum Moderators: open

Message Too Old, No Replies

PR and links to dereferrer.php?url=http://somesite

If dereferrer.php is denied in robots.txt, does it still affect PR?

         

ruserious

8:31 pm on Jan 31, 2003 (gmt 0)

10+ Year Member



When I disallow dereferrer.php in my robots.txt and I have a lot of links on my page like
mysite.com/dereferrer.php?url=http//someothersite
do those links still have an effect on PR? Do they transfer PR to the sites linked? Do they even count as outbound links or inbound-links or are they not even considered as links?

ruserious

11:07 pm on Jan 31, 2003 (gmt 0)

10+ Year Member



Totally forgot to mention:

dereferrer.php makes a META refresh to the other Site in case this has any influence.

ruserious

10:03 pm on Feb 3, 2003 (gmt 0)

10+ Year Member



If the question is unclear, please ask and I can explain in more detail. Otherwise I assume that nobody has neither any knowledge nor experimented on this topic... (meaning I'll test it and won't bother bumping this topic until I find out something.;))

Yidaki

9:06 am on Feb 4, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I use a similar setup and see that google shows the urls if i search for them but never crawls them. But google didn't obeye the robots.txt and didn't follow or index the links allthough they are listed.

What's interesting is that i use two different methods:

Method 1:
- exampledomain.com/jump?id=12345
- robots.txt entry is disallow: /jump
-> this kind of urls never get listed at google.

Method 2:
exampledomain.com/jump/nofollow/*otherdomain.com/index.htm
- robots.txt entry is disallow: /jump/nofollow
-> this kind of urls ARE listed at google.

Both methods use server side 302 redirects.

So i also ask myself if google just strips the string before the marker * and crawls the linked sites without my knowledge. The other unclear thing is: if google crawls such links what about PR / bad neighbourhood risk?

ruserious

10:20 am on Feb 12, 2003 (gmt 0)

10+ Year Member



Yidaki, although I do not have an answer to your question,

I just wanted to follow up on my own question above.
Judging from my log-files of the current crawl, everything went as it was expected. Google did not touch the dereferrer-links. :)