A/B & Multivariate Testing Software

Reviewing what third party software to select, any recommendations?

[marketingmagic]

We're in the process of launching a new site and part of the launch is going to include setting up a AB and multivariate testing platform.

We're looking at the following companies - just wondering if anyone has any specific recommendations or feedback on these or any other vendor that they can share.

hi Conversion
ion - LiveBall
Visual Website Optimizer
Webtrends Optimize
Vertster
SiteSpect
Optimost
Omniture Test & Target

[CPC_Andrew]

What's the platform? Wordpress? Ecommerce platform?

[marketingmagic]

For now we're just testing landing page performance - registration pages - ultimately will be used across all our web properties. Not sure how the platform ties in exactly...

[still]

I'd go for Google's website optimizer, run it for a year, then create a wishlist to evaluate other products in the market in comparison to Website optimizer.

[marketingmagic]

We reviewed Google's tool and because of the algo it uses you need to run tests forever to get statistically relevant data to make decisions.

We're going to go with visual website optimizer to start with, only 1000/mth for the sort of traffic we're dealing with and no long term contracts. When we need more we'll revisit some of the more expensive and robust tools.

[still]

I was under the impression that it's directly proportionate to the number of variants you are testing, which you would scale proportionate to your traffic profile. How does Google's algorithm differs to that of Visual Website Optimizer's?

Would love to hear how you find the package you are going with after a couple of months of use. If you don't mind, could you post your thoughts when you get a chance.