I am currently using a spreadsheet that was set up for someone else that spits out some information about the statistical significance, but I'd like to explore this issue in a little more depth...
Thanks!
- how many page views did you serve?
- how many unique visitors are there?
- how many actions were taken?
Most of the folks I have seen, have been into the thousands of page views, and atleast 500 uniques. Ultimately, on a smaller scale test - differences less than 10% will have to be explored in greater depth. You will have to make a gut decision. I think if you are wondering if they are significant, it bears further testing.
