Definition
An assessment conducted after a policy, program, or regulation has been implemented that measures outcomes, effectiveness, efficiency, and unintended consequences relative to stated objectives and plausible counterfactuals.
Principle
Principle
Comparing observed outcomes to the intervention’s objectives and to a counterfactual (actual or constructed) permits judgments about effectiveness and causation; the quality of inference depends on data, design and timing.
Demonstration
Demonstration
Illustrative scenario — Situation: A tax credit was enacted. Recognition: Evaluators identify outcome metrics and comparison groups. Action: They collect administrative and survey data and apply appropriate comparative methods. Consequence: The evaluation shows whether the credit changed targeted behavior and reveals unforeseen distributional effects, informing revision or continuation decisions.
Misapplication
Misapplication
Semantic error: equating routine monitoring or activity reporting with ex post evaluation. Mistaken inference: attributing causation from before–after comparisons without accounting for other concurrent influences or lacking appropriate counterfactuals.
Consequence
Consequence
Ex post evaluation can inform evidence‑based policy modification, resource reallocation, accountability and termination decisions; however, weak design or inadequate data can produce misleading conclusions with costly policy implications.
Reversal
Reversal
When outcomes manifest only over very long horizons, when reliable data are unavailable, or when baseline and counterfactual conditions cannot be approximated, ex post evaluation may be inconclusive or misleading.
Boundary
Boundary
Clearly within: structured outcome assessment after implementation using comparison logic. Boundary case: program monitoring that includes some outcome indicators but lacks counterfactual analysis. Clearly outside: ex ante impact assessments or feasibility studies conducted before implementation.
Semantic Tension
Semantic Tension
Accountability ↔ Learning — evaluations may be used to sanction or to improve policy; these uses place different demands on design, timing and incentives.
Synthesis
Synthesis
Ex post evaluation is the methodological practice of testing whether implemented interventions produced intended effects and why; its value rests on appropriate causal design, suitable data and realistic timing.