Welcome to WebmasterWorld Guest from 54.160.177.33

Message Too Old, No Replies

Best way to include affiliate links?

     
2:55 pm on Jul 24, 2008 (gmt 0)

Junior Member

10+ Year Member

joined:May 13, 2003
posts: 151
votes: 0


Hi,

As I continue to struggle to escape the dreaded -950, awhile ago I robot.txt'd my redirected links to affiliates.

This shows up in WMT as about 50,000 out-of-bounds pages, compared to (only coincidentally!) 50,000 pages indexed. Perhaps this ratio is to high? Perhaps G doesn't like so many out-of-bounds pages?

It's clear that G follows the links anyway (for awhile, I had the affiliate pages in the SERPs for several terms, which should never have happened) - how can I completely obfuscate those affiliate links? Or should I be more open about it instead?!?

8:05 pm on July 24, 2008 (gmt 0)

Senior Member

WebmasterWorld Senior Member tedster is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:May 26, 2000
posts:37301
votes: 0


robots.txt does not disallow links, it disallows urls on your domain. Do you mean you are disallowing every url on your website where affiliate links appear?
8:15 pm on July 24, 2008 (gmt 0)

Senior Member

WebmasterWorld Senior Member 5+ Year Member

joined:May 31, 2008
posts:661
votes: 0


tdster: I guess he puts a redirect-script in one folder where all the affiliate-links point, disallows that directory and the script redirects to the actual affiliate-url.

AnonyMouse: how are your links formed?
I had the same technique once on a site I built for a client and we used something like /norobots/affil1.php?product=123456, google shows a few hundreds as disabled by robots.txt but not nearly as many as there are (with ~ 100.000 pages indexed, about 30.000 linking to those affiliate-redirects).

8:53 pm on July 24, 2008 (gmt 0)

Junior Member

10+ Year Member

joined:May 13, 2003
posts: 151
votes: 0


Rather than a directory, I just disallowed one file. I use:

/norobots.php?productid=123456&othervars=etc

And in .htaccess:
RewriteRule (.*)$ /norobots.php?path=$1

And finally in robots.txt:
User-agent: *
Disallow: norobots.php

(Obviously the file is not called "norobots"!)

As I say, the strange thing is that for awhile I had the pages linked to actually appearing high up in the SERPS. G shd not have accessed the file, let alone followed the redirected links through to the final affiliate page.

Whereas beforehand I had thought that G wouldn't like to see loads of links out to affiliates, now I'm wondering if G also doesn't like it of you try to "hide" those links from them. Does that mean that it's impossible to rank an affiliate site? That once you include affiliate links in your site, it's game over? Oh, this -950 hell!

10:13 pm on July 24, 2008 (gmt 0)

Senior Member

WebmasterWorld Senior Member jimbeetle is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Oct 26, 2002
posts:3292
votes: 6


Outgoing affiliate links aren't a problem for Google, there's no need to hide them. The only thing Google doesn't like are "thin" affiliate sites, those with little unique content and mostly copied product descriptions. If that describes your site, well, than either hang it up or look into some industrial strength cloaking. ;-)

If that doesn't describe your site then dig down deep into it, tear it apart 'til you find what might be wrong. Read tedster's and other folks' posts on the -950 thingy and possible mega menu thingy. (I'm sure you probably did already, but ya' never know what you might find going back over them.)

2:56 pm on July 25, 2008 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month

joined:Sept 25, 2005
posts:966
votes: 68


Have you considered using rel="nofollow" on your affiliate links?
11:20 am on July 28, 2008 (gmt 0)

Junior Member

10+ Year Member

joined:May 13, 2003
posts:151
votes: 0


Bearing in mind that I have my affiliate links using a redirect script which is disallowed to robots, it seems weird to me that in WMT I have 950 "not found" pages - all referring to expired affiliate links i.e. redirect.php?productid=123456 resolves to a 404 on the provider site.

I.e. Google is totally ignoring my disallow statement...