Learn / Biostatistics / Sampling and estimation
Sampling variation, standard error and the central limit theorem
13 minute read · 6-question quiz
What you will learn
Explain what a sampling distribution is and why it matters
Calculate and interpret a standard error of a mean and of a proportion
State the central limit theorem and why it justifies many methods
Imagine drawing a sample of 100 adults, measuring systolic blood pressure (SBP) and calculating the mean. Draw another sample of 100 and the mean will differ a little. Repeat thousands of times: the collection of those sample means is the sampling distribution of the mean. Its centre is the true population mean; its spread tells us how much any one sample mean is likely to miss the truth.
The standard deviation of the sampling distribution is called the standard error (SE).
SD describes people. SE describes how precisely we have estimated a statistic.
The formulas
The central limit theorem (CLT)
The central limit theorem is the most useful result in statistics. It says that, for reasonably large samples, the sampling distribution of a mean is approximately normal, whatever the shape of the original data, with mean equal to the population mean and SD equal to σ / sqrt(n).
This is why we can use normal-based confidence intervals and tests for means of skewed variables such as hospital stay, provided the sample is not tiny. A rough rule: n ≥ 30 is often adequate for moderately skewed data; strongly skewed data (income, viral load) need more, or a log transformation. For proportions the normal approximation works well when both np and n(1-p) are at least about 10.
Standard deviation or standard error: which to report?
- Use SD to describe the spread of the observations in your sample ("mean age 34.2, SD 8.1 years").
- Use SE (or, better, a confidence interval) to express uncertainty in an estimate ("mean difference 4.2 mmHg, 95% CI 1.1 to 7.3").
Journals warn against presenting "mean ± SE" as a description of the data, because the SE looks deceptively small and shrinks as n grows, while the spread of people does not.
Summary
The sampling distribution is how a statistic would vary over repeated samples; its SD is the standard error.
SE of a mean = s/√n; SE of a proportion = √(p(1 − p)/n).
Quadrupling n halves the SE.
The central limit theorem makes sample means approximately normal for moderate to large n.
Use SD to describe people and SE or a confidence interval to describe an estimate.
Check your understanding
Draft study guide. Spotted an error or something unclear? Tell us at hello@scintria.com. This is educational material, not clinical or regulatory advice.