homepage Welcome to WebmasterWorld Guest from 54.225.57.156
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / WebmasterWorld / Website Analytics - Tracking and Logging
Forum Library, Charter, Moderators: Receptional & mademetop

Website Analytics - Tracking and Logging Forum

    
Don't put too much faith into Google analytics Experiments
I did a test to see my margin of error.
Roxster




msg:4607132
 8:06 pm on Sep 3, 2013 (gmt 0)

My webmaster did one A/B test since to see what the margin of error as my programmer requested. He took the home page and tested it against the exact same home page. Over 36,000 visitors, 15 days of testing, yet a 12% improvement to the duplicated home page with no difference! Feeding more traffic to the better converting page likely plays a role in the difference. It looks like all the prior A/B google experiments may be flawed as well.



Variation

Experiment Visits

Conversions

Conversion Rate

Compare to Original

Probability of Outperforming Original






Original
11,921 1,336 11.21%

0%
0.0%




Same page no difference
24,545 3,077 12.54%

12%
83.3%

 

Lexur




msg:4607166
 5:56 am on Sep 4, 2013 (gmt 0)

Great.
Now you just need to repeat the test twenty times and become rich without change a line of code. :-)

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / WebmasterWorld / Website Analytics - Tracking and Logging
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved