Skip to content
Scintria
ToolsGrant writerFunding
HomeLiteratureClinical trialsEvidence LabProtocol packData analysisLearnProjectsLibraryReferencesApplications
Start free
ScintriaStart free

Learn / Public Health / Planning, monitoring and evaluating programmes

Monitoring and evaluation

13 minute read · 6-question quiz

Download this lesson as a colour Word or PDF study guide with the figures and answers. Included in paid plans; reading and quizzes stay free.Sign in

What you will learn

  • Distinguish monitoring from evaluation and process from outcome indicators

  • Choose good indicators and write their numerator and denominator

  • Describe common evaluation designs and how to attribute change

Monitoring is the continuous tracking of activities and results to see whether the programme is on course. Evaluation is a periodic, systematic assessment of whether the programme achieved its objectives, and why.

  • Monitoring asks: are we doing what we planned, on time and within budget?
  • Evaluation asks: did it work, for whom, at what cost, and what should change?

Indicators

An indicator is a measure that shows change. Good indicators are valid, reliable, sensitive and feasible to collect. Each should have a clear definition, a numerator and denominator, a data source, a frequency and a baseline and target.

  • Input and process indicators: for example, the percentage of health centres with no stock-out of rapid tests.
  • Output indicators: the number of women tested.
  • Outcome indicators: the proportion of pregnant women with a first visit before 12 weeks.
  • Impact indicators: maternal mortality ratio.

Worked example: defining an indicator

Indicator: Percentage of pregnant women who start antenatal care before 12 weeks.

  • Numerator: pregnant women attending a first antenatal visit at less than 12 weeks.
  • Denominator: all pregnant women attending a first antenatal visit in the same period.
  • Source: facility registers, reported through DHIS2.
  • Frequency: monthly.
  • Baseline: 20%. Target: 40% by December 2028.

If, in one month, 60 of 300 first visits were before 12 weeks, the indicator is 60 / 300 = 20%, which equals the baseline. Without a baseline and definition the number would have little meaning.

60First visits before 12 weeks300All first visits20%Indicator
An indicator is a numerator over a denominator, compared with a baseline and a target.

Evaluating whether the programme caused the change

A rise in an indicator does not prove that the programme caused it. Other forces may be at work. Common designs include:

  • Before-after: simple but cannot rule out trends or other events.
  • Comparison group (controlled before-after or difference-in-differences): compare change in programme areas with change in similar non-programme areas.
  • Interrupted time series: many measurements before and after the start.
  • Randomised designs such as cluster trials, the strongest for attribution.

Evaluators also assess relevance, effectiveness, efficiency, impact and sustainability (the OECD DAC criteria).

010203040012Year (0 = start)Early antenatal attendance (%)Programme districtComparison district
Both areas improve, but the programme district improves by 18 points versus 5 in the comparison district.

Difference-in-differences logic

The programme's extra effect is the change in the programme area minus the change in the comparison area: (38 − 20) − (26 − 21) = 18 − 5 = 13 percentage points in this example.

Too many indicators

Collecting dozens of indicators exhausts staff and produces poor data. Choose a small set that matters for decisions, and make sure someone will use each one.

Check yourself

Take one indicator from your work. Write its numerator, denominator, source, frequency, baseline and target. If you cannot, it is not yet ready to use.

Summary

  • Monitoring tracks implementation continuously; evaluation judges effect and value periodically.

  • A good indicator has a definition, numerator, denominator, source, frequency, baseline and target.

  • Comparison groups help show that a programme, not other trends, caused a change.

  • Evaluations also consider relevance, efficiency and sustainability.

Check your understanding

Question 1
1

Monitoring differs from evaluation in that monitoring is:

Question 2
2

60 of 300 first antenatal visits are before 12 weeks. The indicator is:

Question 3
3

Number of women tested is an indicator at the level of:

Question 4
4

A before-after study without a comparison group cannot:

Question 5
5

Programme area rises 20→38; comparison area 21→26. The difference-in-differences is:

Question 6
6

Which is an OECD DAC evaluation criterion?

Draft study guide. Spotted an error or something unclear? Tell us at hello@scintria.com. This is educational material, not clinical or regulatory advice.

Needs assessment and programme planningEconomic evaluation and priority setting