Skip to content
Scintria
ToolsGrant writerFunding
HomeLiteratureClinical trialsEvidence LabProtocol packData analysisLearnProjectsLibraryReferencesApplications
Start free
ScintriaStart free

Learn / Epidemiology / Doing epidemiology: surveys, evidence and ethics

Finding and weighing the evidence

14 minute read · 6-question quiz

Download this lesson as a colour Word or PDF study guide with the figures and answers. Included in paid plans; reading and quizzes stay free.Sign in

What you will learn

  • Frame a question with PICO or PECO and plan a search

  • Appraise a study using risk-of-bias thinking and design-specific checklists

  • Summarise a body of evidence with GRADE and translate it into a recommendation

Evidence-based public health combines the best available research evidence with local context, resources and values. The core skills are asking a precise question, finding the research, judging its quality and applying it.

Frame the question

  • PICO (interventions): Population, Intervention, Comparator, Outcome. In HIV-positive adults (P), does isoniazid preventive therapy (I) compared with no preventive therapy (C) reduce incident TB (O)?
  • PECO (exposures): Population, Exposure, Comparator, Outcome. In children under five (P), does indoor cooking smoke (E) compared with clean fuel (C) increase pneumonia (O)?
  • Add time and setting (PICOTS), and decide study designs to include.

A systematic search

  1. Choose databases: PubMed/MEDLINE, Embase, Cochrane Library, Global Health, CINAHL, African Journals Online, and trial registries; include grey literature (WHO, ministry reports).
  2. Write search strings combining synonyms with OR and concepts with AND, using controlled vocabulary (MeSH) and free text.
  3. Record the date, databases and exact strings.
  4. De-duplicate and screen titles and abstracts, then full texts, ideally with two reviewers, and record reasons for exclusion in a PRISMA flow diagram.
  5. Extract data into a standard form; appraise risk of bias; synthesise (narrative or meta-analysis).
  6. Register the protocol (PROSPERO).
2,400Records identified1,900After duplicates removed1,900Screened by title and abstract160Full texts assessed28Included in review
A PRISMA-style flow: most records are excluded; each step is documented. (Illustrative numbers.)

Critical appraisal: ask a few good questions

DesignKey questions
RCTRandom sequence? Concealed? Blinded outcome assessment? Complete follow-up? Analysed as randomised? Outcomes as registered?
CohortRepresentative? Exposure measured accurately before outcome? Follow-up complete? Confounders measured and adjusted?
Case-controlCases well-defined? Controls from the same source population? Exposure measured the same way? Recall bias?
Cross-sectionalSampling method? Response rate? Valid measurement? Analysis allowing for design?
Diagnostic accuracyReference standard for all? Spectrum of patients? Blinded interpretation?
QualitativeClear research question? Appropriate sampling and analysis? Reflexivity? Credible findings?

Use tools: Cochrane RoB 2 (trials), ROBINS-I (non-randomised interventions), Newcastle-Ottawa Scale (cohort and case-control), QUADAS-2 (diagnostic accuracy), JBI checklists, CASP.

GRADE: certainty of a body of evidence

The GRADE approach rates the certainty of evidence for each important outcome as high, moderate, low or very low. Randomised trials start high and observational studies start low. Certainty is downgraded for risk of bias, inconsistency, indirectness, imprecision and publication bias, and upgraded for large effects, dose-response or plausible confounding that would reduce the effect.

A recommendation also considers the balance of benefits and harms, values and preferences, resource use, equity, acceptability and feasibility. Strong recommendations can be made with moderate evidence, and weak recommendations with high evidence, depending on these factors. GRADE underpins WHO guidelines.

From evidence to recommendation

A review of 28 trials shows community health worker home visits reduce neonatal mortality (RR 0.75, 95% CI 0.65 to 0.86; moderate certainty because of some imprecision and variable risk of bias). Costs are modest, health workers and families accept the programme and it improves equity. A national policy group makes a strong recommendation to implement it, with monitoring of coverage and quality and a plan to adapt training and supervision to each district.

Systematic review is not the end of the road

Even good reviews answer 'does it work on average?' Implementation needs local evidence on feasibility, cost, equity and acceptability. Use implementation science frameworks (RE-AIM, CFIR) and routine data to learn what happens in practice.

Be wary of

Single studies presented as settled science; reviews without protocols; 'vote counting' of significant results; reviews pooling very different interventions; industry-funded studies without independent replication; predatory journals. Always check the registry entry and funding.

Summary

  • Frame questions with PICO or PECO; search several databases; document with PRISMA.

  • Appraise each study with design-appropriate tools (RoB 2, ROBINS-I, NOS, QUADAS-2, CASP).

  • GRADE rates certainty from high to very low; recommendations also consider harms, values, cost and equity.

  • Evidence needs local implementation data as well as average effects.

  • Check registration, funding and conflicts of interest.

Check your understanding

Question 1
1

PICO stands for:

Question 2
2

GRADE starts randomised trials at:

Question 3
3

Which is NOT a reason to downgrade certainty in GRADE?

Question 4
4

The tool for assessing risk of bias in randomised trials is:

Question 5
5

Two independent reviewers for screening are used to:

Question 6
6

A PRISMA flow diagram shows:

Draft study guide. Spotted an error or something unclear? Tell us at hello@scintria.com. This is educational material, not clinical or regulatory advice.

Planning and running a population surveyEthics, data protection and writing it up