This article explains why “impact” is a crucial evaluation standard in monitoring and evaluation practice. It discusses how impact evaluation can help assess the broader and long-term effects of a program or intervention by comparing actual outcomes to a counterfactual scenario, and provides examples of impact evaluation questions in various development sectors. The article also emphasizes the importance of using impact evaluation in conjunction with other evaluation standards to obtain a comprehensive assessment of a program’s performance.

Impact as an evaluation standard #

“Impact” is a crucial evaluation standard in monitoring and evaluation practice, as it helps assess the broader and long-term effects of a program or intervention. Impact evaluation typically seeks to answer the question: “What would have happened if the program had not been implemented?” By comparing the actual outcomes of a program to a counterfactual scenario, impact evaluation can determine the program’s net contribution to development outcomes.

Impact evaluation can be challenging and complex, as it requires careful consideration of causality, attribution, and the counterfactual scenario. To conduct an impact evaluation, evaluators may use various methods, including randomized controlled trials, quasi-experimental designs, or before-and-after comparisons.

Impact evaluation can be used to assess a wide range of development programs, including those in health, education, agriculture, infrastructure, and social protection. Some examples of impact evaluation questions include:

• What is the impact of a nutrition program on children’s health and cognitive development?
• What is the impact of a vocational training program on youth employment and income levels?
• What is the impact of a road infrastructure project on local economic growth and poverty reduction?
• What is the impact of a cash transfer program on household consumption and well-being?

Impact evaluation can provide valuable insights into a program’s net contribution to development outcomes, and help identify effective and efficient ways to improve development policies and programs.

Examples of Impact as an Evaluation Standard in Monitoring and Evaluation Practice #

Here are some examples of how “impact” can be used as an evaluation standard in monitoring and evaluation practice:

1. A malaria control program aims to reduce the burden of malaria in a particular region. An impact evaluation could compare the prevalence of malaria in the region before and after the program was implemented, as well as in a control group that did not receive the intervention. The impact evaluation could estimate the program’s net contribution to reducing malaria cases and deaths, as well as the associated economic benefits.
2. An education program aims to improve learning outcomes among primary school students. An impact evaluation could compare the test scores of students who participated in the program to those who did not, as well as analyze the long-term effects on educational attainment and labor market outcomes. The impact evaluation could estimate the program’s net contribution to improving learning outcomes and economic opportunities for students.
3. A road infrastructure project aims to improve access to markets and services in a rural area. An impact evaluation could compare the economic growth and poverty reduction in the area before and after the project was implemented, as well as in a control group that did not receive the intervention. The impact evaluation could estimate the program’s net contribution to improving economic opportunities and reducing poverty in the area.

Conclusion #

Overall, impact evaluation can provide valuable insights into a program’s net contribution to development outcomes and help identify effective and efficient ways to improve development policies and programs. However, impact evaluation should be used in conjunction with other evaluation standards, including efficiency, effectiveness, relevance, and sustainability, to obtain a comprehensive assessment of a program’s performance.