Learn / Biostatistics / Sampling and estimation
Populations, samples and the ways studies go wrong
13 minute read · 6-question quiz
What you will learn
Distinguish a population from a sample, and a parameter from a statistic
Compare simple random, systematic, stratified, cluster and convenience sampling
Separate random error (chance) from systematic error (bias) and name common sources of selection bias
A population is everyone you want to learn about: all pregnant women in Mbale district, all adults with type 2 diabetes in Kenya. A sample is the smaller group you actually study. A number that describes the population (the true mean blood pressure) is a parameter; the same number calculated from your sample is a statistic, our estimate of the parameter. Biostatistics is largely the discipline of saying how far a statistic is likely to be from its parameter.
Sampling methods
Systematic sampling (every 5th patient through the door) is a convenient version of random sampling that works well unless the list has a hidden pattern. Multistage sampling combines methods: the Demographic and Health Surveys sample enumeration areas (clusters), then households within them.
Two kinds of error
- Random error (sampling error) is chance. A different random sample would give a slightly different answer. It shrinks as the sample grows and is measured by the standard error and confidence intervals.
- Systematic error (bias) is a flaw in design or measurement that pushes results in one direction. Making the sample bigger does not reduce it. A huge biased sample gives a very precise wrong answer.
Common biases to recognise
- Selection bias: the people studied differ systematically from those you want to describe. A survey conducted at a hospital outpatient clinic over-represents the sick and those who can afford to travel.
- Non-response bias: people who decline or cannot be found differ from those who take part. If 40% of men are away from home at the time of a household visit, a survey of "heads of household" will miss them.
- Loss to follow-up (attrition): in cohorts and trials, people who drop out often have worse outcomes. Analysing only completers can make a treatment look better than it is.
- Survivorship and healthy-volunteer bias: people who join prevention studies are usually healthier than the general population.
- Measurement and recall bias: instruments that are miscalibrated, or mothers who recall exposures differently after a child has become ill.
Summary
Parameters describe populations; statistics describe samples and estimate parameters.
Probability sampling (simple random, stratified, cluster) allows valid generalisation; convenience sampling does not.
Random error shrinks with sample size; bias does not.
Selection, non-response and attrition biases are the most common threats; report how many were eligible, invited, enrolled and analysed.
Check your understanding
Draft study guide. Spotted an error or something unclear? Tell us at hello@scintria.com. This is educational material, not clinical or regulatory advice.