Welcome to WebmasterWorld Guest from

Forum Moderators: DixonJones & mademetop

Message Too Old, No Replies

Don't put too much faith into Google analytics Experiments

I did a test to see my margin of error.

8:06 pm on Sep 3, 2013 (gmt 0)

5+ Year Member

My webmaster did one A/B test since to see what the margin of error as my programmer requested. He took the home page and tested it against the exact same home page. Over 36,000 visitors, 15 days of testing, yet a 12% improvement to the duplicated home page with no difference! Feeding more traffic to the better converting page likely plays a role in the difference. It looks like all the prior A/B google experiments may be flawed as well.


Experiment Visits


Conversion Rate

Compare to Original

Probability of Outperforming Original

11,921 1,336 11.21%


Same page no difference
24,545 3,077 12.54%

5:56 am on Sep 4, 2013 (gmt 0)

5+ Year Member

Now you just need to repeat the test twenty times and become rich without change a line of code. :-)

Featured Threads

Hot Threads This Week

Hot Threads This Month