Learn / Biostatistics / Sample size and power
Why sample size matters: the four ingredients of power
12 minute read · 6-question quiz
What you will learn
Explain why an underpowered study is both a scientific and an ethical problem
Name the ingredients of a sample size calculation and how each moves the answer
Choose a defensible effect size (the minimal clinically important difference)
A trial that is too small cannot detect a real benefit, and a trial that is too large exposes more patients than necessary to an inferior treatment and wastes money. Sample size calculation is the discipline of getting between them. Ethics committees, funders and journals expect it, and a flawed calculation is among the commonest reasons for protocol rejection.
Power is the probability that the study will detect (reject H0 for) an effect of a stated size, if that effect truly exists. Conventional targets are 80% or 90%.
The ingredients
For comparing two groups, every sample size formula combines the same four elements.
1. Significance level (α)
The false-positive risk you accept, usually 0.05 two-sided. Smaller α needs a larger sample.
2. Power (1 − β)
The chance of detecting the effect if real. 80% is the minimum for most trials; 90% for important or hard-to-repeat trials.
3. Effect size
The smallest difference worth detecting (the minimal clinically important difference). Halve the effect size and you need about four times the sample.
4. Variability
SD for continuous outcomes; the control-group proportion for binary outcomes; the event rate for survival. More noise needs more participants.
How power rises with sample size
Consider a trial comparing mean SBP between two arms, with SD 15 mmHg and a true difference of 5 mmHg, at α = 0.05 (two-sided).
Why underpowered studies hurt
- They miss real effects (type II error), so useful treatments are abandoned.
- The significant results they do produce tend to overestimate the effect (the 'winner's curse').
- They waste participants' contribution, since an inconclusive study answers nothing.
- Pooling many small studies can rescue some information (meta-analysis), but the original waste is permanent.
Why overpowered studies hurt too
- More people than needed receive the inferior arm.
- Trivial, clinically meaningless differences become 'significant'.
- Resources are consumed that could answer another question.
The formula's family tree
Summary
Power is the chance of detecting a real effect of a stated size; 80% to 90% is the norm.
Four ingredients: α, power, effect size and variability.
Halving the effect size roughly quadruples the sample size.
Choose the effect from clinical importance, not from an optimistic pilot.
Both underpowered and overpowered trials are ethically problematic.
Check your understanding
Draft study guide. Spotted an error or something unclear? Tell us at hello@scintria.com. This is educational material, not clinical or regulatory advice.