Learn / Biostatistics / Statistics in clinical trials and evidence synthesis
Meta-analysis, heterogeneity and reporting standards
15 minute read · 6-question quiz
What you will learn
Pool results of several trials with fixed- and random-effects methods and read a forest plot
Interpret heterogeneity (Q, I²) and publication bias
Name the main reporting guidelines (CONSORT, STROBE, PRISMA, TRIPOD, SPIRIT) and what they require
A single trial rarely settles a question. A systematic review finds all relevant studies by a reproducible method, appraises them and summarises them. A meta-analysis statistically combines their results into one estimate with greater precision.
Pooling: the weighted average
Each study gives an effect estimate (often a log risk ratio, log odds ratio or mean difference) and its standard error. The pooled estimate is a weighted average where more precise studies get more weight.
- Fixed-effect (inverse-variance) model: assumes all studies estimate one common true effect; weight = 1/SE².
- Random-effects model (DerSimonian-Laird or REML): assumes each study's true effect varies around an average, with between-study variance τ²; weight = 1/(SE² + τ²). It gives smaller studies relatively more weight and produces wider intervals. Preferred when studies differ in populations or settings.
Heterogeneity
Are the trials telling the same story? Look at the forest plot: do the intervals overlap? Then quantify.
- Cochran's Q: tests whether the variation exceeds chance. Low power with few studies.
- I²: the percentage of total variability due to genuine differences between studies rather than chance. Rough guide: 25% low, 50% moderate, 75% high (Higgins).
- τ²: the between-study variance on the effect scale.
- Prediction interval: the range in which the true effect of a new study is expected to fall. Wider than the CI of the pooled mean, and more honest when heterogeneity exists.
Explore causes with subgroup analysis and meta-regression (dose, setting, risk of bias), recognising that they are observational comparisons between trials. If studies are too different, don't pool.
Bias in meta-analysis
- Publication bias: positive trials are published more often. A funnel plot (effect against precision) should be symmetric; asymmetry suggests small-study effects. Test with Egger's test only when there are at least ~10 studies.
- Risk of bias in included trials: use the Cochrane RoB 2 tool (randomisation process, deviations, missing data, outcome measurement, selective reporting). Pooling biased trials gives a precise, biased answer.
- GRADE rates the certainty of the body of evidence (high, moderate, low, very low).
Reporting guidelines: say what you did, so others can judge
| Guideline | For | Key items |
| CONSORT 2010 | Randomised trials | Flow diagram of participants; primary outcome and sample size; randomisation and blinding; ITT; effect size with CI; harms; registration |
| SPIRIT | Trial protocols | Objectives, design, eligibility, interventions, outcomes, sample size, analysis plan, DSMB |
| STROBE | Observational studies | Setting, selection, confounding, bias, missing data |
| PRISMA 2020 | Systematic reviews | Search strategy, selection flow, risk of bias, synthesis methods |
| TRIPOD | Prediction models | Development, validation, performance |
| STARD | Diagnostic accuracy | Sensitivity and specificity with CIs; flow of participants |
| CHEERS | Economic evaluations | Costs, outcomes, perspective |
Most journals require the relevant checklist. Use the EQUATOR Network (equator-network.org) to find any guideline. Follow it from the start, when writing the protocol, and not just when preparing a manuscript.
Summary
Meta-analysis pools study estimates with inverse-variance weights; random-effects allows true effects to vary.
Read the forest plot: squares for studies, diamond for the pooled estimate, line of no effect.
Heterogeneity: Q, I² (percentage of variation beyond chance) and τ²; use prediction intervals.
Publication bias, risk of bias and certainty (GRADE) shape how far to trust the result.
Use CONSORT, SPIRIT, STROBE, PRISMA, TRIPOD, STARD and register trials in advance.
Check your understanding
Draft study guide. Spotted an error or something unclear? Tell us at hello@scintria.com. This is educational material, not clinical or regulatory advice.