Evan's Awesome A/B Tools (home):

Sample Size Calculator  |  Chi-Squared Test  |  Sequential Sampling  |  2 Sample T-Test  |  Survival Times  |  Count Data

Question: Does the rate of success differ across two groups?

[ clear ] [ link ]
# successes # trials Confidence interval
Sample 1: /
10.2% – 13.4%
Sample 2: /
10.2% – 13.2%
Verdict:
No
(p = 0.21)
Confidence level:
95%

If the experiment is repeated many times, the confidence level is the percent of the time each sample's success rate will fall within the reported confidence interval.

It is also the percent of the time no difference will be detected between the two groups, assuming no difference exists.

If you like this, check out Wizard — the easy Mac statistics app.