homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / WebmasterWorld / Website Analytics - Tracking and Logging
Forum Library, Charter, Moderators: DixonJones & mademetop

Website Analytics - Tracking and Logging Forum

Calculating % Chance to Beat Original

WebmasterWorld Senior Member 10+ Year Member

Msg#: 4522579 posted 1:42 pm on Nov 26, 2012 (gmt 0)

Since Google weaned us off of their amazing multivariate testing tool earlier this year, Iím trying to develop our own in house A/B testing program. In hindsight, I should have done this long ago as a customized solution would have saved tons of time over copying and pasting that code for every test.

Iíve got just about everything we used with Google done now but thereís one statistic they displayed that Iím having trouble figuring out how to calculate, % Chance to Beat Original.

Given the conversion rate and margin of error (using a 95% confidence level) of two variations, how would a person calculate that?

Iím assuming itís not quite as straightforward as simply calculating the difference in means because what youíre really doing is calculating the difference between two normal distrubtions.


Global Options:
 top home search open messages active posts  

Home / Forums Index / WebmasterWorld / Website Analytics - Tracking and Logging
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved