Welcome to WebmasterWorld Guest from

Forum Moderators: DixonJones & mademetop

Message Too Old, No Replies

Don't put too much faith into Google analytics Experiments

I did a test to see my margin of error.

8:06 pm on Sep 3, 2013 (gmt 0)

Junior Member from US 

10+ Year Member

joined:July 14, 2006
posts: 155
votes: 1

My webmaster did one A/B test since to see what the margin of error as my programmer requested. He took the home page and tested it against the exact same home page. Over 36,000 visitors, 15 days of testing, yet a 12% improvement to the duplicated home page with no difference! Feeding more traffic to the better converting page likely plays a role in the difference. It looks like all the prior A/B google experiments may be flawed as well.


Experiment Visits


Conversion Rate

Compare to Original

Probability of Outperforming Original

11,921 1,336 11.21%


Same page no difference
24,545 3,077 12.54%

5:56 am on Sept 4, 2013 (gmt 0)

Senior Member from ES 

WebmasterWorld Senior Member 10+ Year Member

joined:Nov 13, 2005
votes: 12

Now you just need to repeat the test twenty times and become rich without change a line of code. :-)

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members