When is an A/B test significant?
This calculator uses a two-proportion z-test to determine whether the difference between your variants is real or falls within the margin of error. The confidence (1 minus the p-value) tells you how sure you can be.
A common mistake is stopping a test too early as soon as a variant wins. Wait until you reach at least 95 percent confidence with enough conversions per variant.