Forum Moderators: martinibuster

Message Too Old, No Replies

What's the best way of providing outbound links that SEs can't see?

exit.cgi type... or something else like javascript

         

Macro

11:10 am on Sep 16, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I've got a 1000 page site that has a lot of content and most of the pages are PR4s and PR5s. But I have a lot of outbound links (several thousand) that are "losing" me PR.

I'd like to contain that leak. Websites who link to me will continue to get a clean link back in html that Google can see, and this is irrespective of what PR those sites have. But there are a lot of sites that I need to link to who wouldn't dream of linking back to me. I'd like to shield those outbound links somehow and improve the overall PR of this site's pages. I'm sure this has been covered before but can't seem to find it.

I obviously don't want to upset the big G because they do send me hundreds of thousands of visitors each year.

Please help.

toolkit

2:38 pm on Sep 16, 2003 (gmt 0)

10+ Year Member



A redirect script that uses an id parameter (eg. go.cgi?id=35)
as Googlebot doesn't like reading id parameters

Also you could block the redirect script in your robots.txt file

Macro

2:53 pm on Sep 16, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



toolkit, thanks for your reply.

Pardon my ignorance but what's a redirect script and what's an id parameter?

go.cgi?id=35 sounds good. Sounds like I install a cgi script in my cgi bin, allocate a number to each external URL and then whenever I want to link to an external site I link to go.cgi?id=xxx instead. Where would I find a cgi script like that?

I don't know if it's relevant but the site was done in Frontpage 2000.

I have a robots.txt file, and could setup that block. Good idea! Otherwise Google will just scroll through all the links I've got and the purpose will be defeated.

toolkit

3:08 pm on Sep 16, 2003 (gmt 0)

10+ Year Member



Sounds like I install a cgi script in my cgi bin, allocate a number to each external URL and then whenever I want to link to an external site I link to go.cgi?id=xxx instead

You've got the idea exactly :)

heres an example script: [ftls.org ]

...with others available by performing a search on [hotscripts.com ] for something like 'redirect'

HTH

Macro

3:30 pm on Sep 16, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Aha, good link. I'll try that now. Thanks very much.

(I did try the "redirect script" in a Google search but was getting SERPS of a different kind of redirect - redirects based on browser type etc)

Macro

4:46 pm on Sep 16, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



nope, it doesn't work :-(

When I go to a page that has a href to
/cgi-bin/redirect.cgi?http://www.webmasterworld.com/
and click on the link the browser address bar shows

[mysite.com...]

but I get a HTTP 500 - Internal server error

Any other suggestions?

SMXwebcrawler

5:19 pm on Sep 16, 2003 (gmt 0)

10+ Year Member



Macro did you chmod the file so it has the correct permissions otherwise it will not execute?

Should be set as 755 I think. Either that or the redirect file has some editable parameters in it which you have not set.

Macro

5:27 pm on Sep 16, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I've spent hours looking for this but all the redirect scripts seem to be scrips that perform a function similar to
<META http-equiv="refresh" content="0; url=http://www.othersite.com">

or they perform a redirect based on browser type. I can't seem to find anything that offers the option of my allocating numbers to external URLs and using the above example of go.cgi?id=35.

I did find one called redir.pl (similar to the ftls example above) on the watson-net.com site but it wants a cgi.pm module and a ctime.pl - something about standard parts of a perl library. Not something I suspect will work for me as I don't know what all that is :-(

Do I perhaps want to be looking for a "links script"?

Macro

5:30 pm on Sep 16, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



SMXwebcrawler, our posts crossed.

What's chmod? I'm sorry, it doesn't appear like I know anything at all.

I do have other cgi scripts in the cgi-bin which do work (installed there by the e-commerce software) but I thought I just had to post the script in the cgi-bin. I've seen chmod mentioned elsewhere on webmasterworld and it sounds complicated.

rogerd

6:01 pm on Sep 16, 2003 (gmt 0)

WebmasterWorld Administrator 10+ Year Member



Macro, if you are using an FTP program you can also check permissions that way. Look for a "permissions" or "set attributes" option. (Note that permissions on a Windows server are handled differently, and these comments apply to Linux/UNIX.)

More fundamentally, why are you convinced that the outbound links are losing you PR? While it is true that on any given page the PR will be divided among its links, your site isn't like a leaky bucket that will empty itself of PR if you don't plug the outside links. If you have a ton of links on every page that could be a problem, but it has been suggested that a good external link or two might actually help a page/site.

Macro

6:55 pm on Sep 16, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



why are you convinced that the outbound links are losing you PR

'Cause I've got loads of them.

I have an average of about 5-10 external links per page. Max is probably about 20. But because of the large number of pages I have the total outbound links are in the thousands. That has got to affect my PR. When I have 10 external links on a PR5 page and five internal links then those internal links would benefit if I "hid" the external ones. Not that PR is that important anyway, but it does help when asking for reciprocals. The higher your PR the more likely you'll get a webmaster to agree to exchanging links.

My site is in Frontpage on a Windows server.

It seems like I have set the editable parameters correctly. Tehre isn't really much to set.

Thanks for the tip on using ftp to see the permissions! There is indeed a Properties/CHMOD for the file. It's set to 777 and owner, group and public have Read, Write and Execute ticked.

nakulgoyal

9:15 pm on Sep 16, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Macro

If you need any help, PM me. I will do it for you. This is a minute's job to install this script.

You can also use some PHP based redirect scripts from hotscripts.

Macro

4:54 pm on Sep 19, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



nakulgoyal, that's a very kind offer. I have PMed you

PatrickDeese

4:58 pm on Sep 19, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



FWIW, in my FTP program, you can right click on files and change the access using the "properties" option.

Macro

7:01 pm on Sep 24, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Sorry guys, I'm back again looking for some help.

Nakulgoyal very kindly offered to help but after chatting with him via MSN and giving him a copy of the script to see if I had done something wrong he said that he'd have a look and get back. Also, that he'd email me a copy of a script that he knows works. But maybe he's busy... I've not heard from him again :-(

Can anyone help? Do you have a script that you are familiar with and that you could recommend? Thanks.

Macro

7:12 pm on Sep 24, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I've tried the above script again (msg 4-7 above). I've tried to set the CHMOD to 755 but it's not saving the changes. This is what happens: I open my ftp program, connect to my site, find the file, right click on it and go to "Properties". I then get a "Properties/CHMOD" window showing that the CHMOD is set to 777. If I change that to 755 then write privileges for "Group" and "Public" get disabled. I then click on "OK" but the ftp program then says:

'SITE CHMOD 755 redirect.cgi': command not understood

Macro

3:20 pm on Sep 26, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



bump

Can anyone help? Do you have a script that you are familiar with and that you could recommend? Thanks.

anybody?

trillianjedi

3:35 pm on Sep 26, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



If you just want to shield an outbound link to stop the search engines following it, why not just do it with javascript?

Although why on earth you would want to do that I don't know - especially if these sites are authoritative (and you say you really need to link to them).

This is not a PR leak, in fact, it's very good SEO to link to them.

TJ

PS: Actually it looks like google can follow JS links:-

[webmasterworld.com...]

Macro

3:46 pm on Sep 26, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Although why on earth you would want to do that I don't know - especially if these sites are authoritative (and you say you really need to link to them).

Some of them are better than others but I do have several thousand outbound links. All that I've read so far suggests that for a given PR 6 page that has 20 links to other pages in my site and 10 links to external pages ...those 20 pages would benefit more from the 10 external links being hidden/removed.

why not just do it with javascript

I'm concerned that Google may at some point "read" js. Even if that's a remote possibility I don't fancy having to re-do thousands of links again. The links are not in the form of a directory but built into the editorial content of hundreds of pages of text and would take a lot of work.

So I would appreciate if anyone has a redirect/exit type script they can recommend for easy of use.

instand1

5:18 pm on Sep 26, 2003 (gmt 0)

10+ Year Member




All that I've read so far suggests that for a given PR 6 page that has 20 links to other pages in my site and 10 links to external pages ...those 20 pages would benefit more from the 10 external links being hidden/removed.

Better distribute the outgoing links over several pages. But external links are good, especially when they contain your keyword in the anchor-text. Having more pages is better since Google likes bigger sites. Adding pages regularly is good.

Yidaki

9:24 pm on Sep 27, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I use this php script jump.php:

<?
$newlocation = $HTTP_GET_VARS["to"];
if ( $newlocation == '' )
{
$newlocation = 'www.yoursitehere.com';
}
print Header("Location: [$newlocation");...]
// or: print Header("HTTP/1.0 301 Moved Permanently", true)
?>

You call the script by this url:
[yoursitehere.com...]

wkitty42

1:55 am on Sep 28, 2003 (gmt 0)

10+ Year Member



yidaki,

if i'm reading that correctly, its using the 301 for the "redirect" and letting the browser head off in the other direction?

Yidaki

9:24 am on Sep 28, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



wkitty42, it's doing a 302 redirect. Optionally uncomment the last line to do a 301 redirect. Forgot to mention: jump.php is disallowed in robots.txt.

>letting the browser head off in the other direction

Don't understand what you mean by this.

willybfriendly

3:35 pm on Sep 29, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Not that PR is that important anyway, but it does help when asking for reciprocals. The higher your PR the more likely you'll get a webmaster to agree to exchanging links.

And if those trading links notice how you are cloaking the outbounds, will they then be likely to trade?

I am late to this discussion, I know. After many hours of reading viewpoints here at WW I must say I have come to agree with those that promote web design based on user needs, vs SE needs. In that sense I do not think I would bother to cloak an outbound link.

Yidaki - how does the PR compare between jump.php and the referring page? Does jump.php show in the SERPS with any regualarity? Or, does the 302 take care of that?

WBF

Velmu

8:22 pm on Sep 29, 2003 (gmt 0)

10+ Year Member




You call the script by this url:
[yoursitehere.com...]

I think your script doesn't work if the address contains &. For example [yoursitehere.com...] wouldn't work correctly.

Yidaki

8:27 pm on Sep 29, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Velmu, absolutely right! Wait for version 1.1 ... ;)

Macro

2:27 pm on Sep 30, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



And if those trading links notice how you are cloaking the outbounds, will they then be likely to trade

willybfriendly, never mind about reading the whole thread, please read message #1.

Everyone else, thanks for all your input. I did need a cgi or pl script but I guess there just isn't one around that's simple to set up :-(

willybfriendly

5:13 am on Oct 1, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



But I have a lot of outbound links (several thousand) that are "losing" me PR.

I had in fact read your first post. Looks to me like the jury is still out on the subject of "losing" PR.

Perhaps with a site your size you can provide some definitive data on this question. Please post back the results on your PR after hiding all of these links.

WBF

franklin dematto

6:28 pm on Oct 1, 2003 (gmt 0)

10+ Year Member



I don't think any of these techniques will help.

Google keeps track of PR entirely on a URL basis. The domain name or site does not matter (except that many links tend to be intrasite).

So, instead of transferring your PR to an external site, you now transfer it to yoursite.com/redirect.cgi?xxxxx . Either way, you are transfering PR.

If you want to avoid this, you need to make sure that Google doesn't see the link in the first place. The simplest way is to use JavaScript to construct the link (of course, this will make those links only work for JS enabled browsers).

BTW, you should know that having some quality outbound links which actually increase your Google rankings, as you willbe considered a "hub."

Macro

7:09 pm on Oct 1, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



franklin, interesting.

Perhaps having a lot of outbound links gets you recognised as a hub and other sites start linking to you and boosting your PR. That's the only way I can see of increasing your PR by having outgoing links.

In the interim, where do you draw the line? Do you acquire PR purely for having a lot of outbound links? That does not seem to be the case.

If I collected an ODP size number of links and organised them as a new site would it go straight to a PR of 9/10? If not then outgoing links do not contribute to PR.

The point about potentially transferring PR to redirect.cgi - which is robots.txt excluded - is a cause for concern.

This 36 message thread spans 2 pages: 36