Evaluation theories provide a framework for understanding the purpose, design, and implementation of program evaluations. They help to guide the evaluation process and inform the selection of evaluation methods and measures.

Table of Contents

• What are Evaluation Theories?
• Utilization-Focused Evaluation Theory
• Systems Theory
• Empowerment Evaluation Theory
• Logic Model Theory
• Realist Evaluation Theory
• Conclusion on Evaluation Theories

What are Evaluation Theories? #

Evaluation theories refer to the conceptual frameworks, models, and principles that guide the systematic assessment and analysis of programs, policies, interventions, and other social phenomena. They provide a set of organizing principles and methodologies for evaluating the effectiveness, efficiency, relevance, and sustainability of various interventions and initiatives in different domains, including education, healthcare, social services, environmental protection, and public policy.

Evaluation theories draw from various disciplines, such as psychology, sociology, economics, statistics, and management, and they may emphasize different aspects of the evaluation process, such as the role of stakeholders, the criteria for success, the methods for data collection and analysis, and the use of evaluation results.

Utilization-Focused Evaluation Theory #

This theory emphasizes the importance of designing evaluations that are useful and relevant to the intended users. The focus is on identifying and addressing the information needs of stakeholders, and using evaluation findings to inform decision-making and program improvement.

Utilization-Focused Evaluation (UFE) is an evaluation theory developed by Michael Quinn Patton that emphasizes the importance of designing evaluations that are useful and relevant to the intended users. The focus is on identifying and addressing the information needs of stakeholders, and using evaluation findings to inform decision-making and program improvement.

UFE is based on the premise that the value of an evaluation lies in its use. Therefore, the evaluation design and methods should be tailored to the specific needs and interests of the stakeholders who will use the evaluation results. This requires a collaborative approach to evaluation, where stakeholders are involved in all stages of the evaluation process, from identifying evaluation questions to interpreting and using the evaluation results.

UFE also emphasizes the importance of building capacity for evaluation among stakeholders, so that they are able to participate in and use evaluations effectively. This includes providing training and support in evaluation methods and data analysis, as well as developing systems and processes to ensure that evaluation findings are used to inform decision-making.

UFE involves three key principles:

1. Use-Driven: The evaluation is designed to meet the specific information needs of stakeholders and to inform decision-making.
2. Collaborative: Stakeholders are actively involved in all stages of the evaluation process, and their input and feedback is valued and used.
3. Iterative: The evaluation is viewed as an ongoing process of learning and improvement, and the evaluation design and methods are adapted as needed to ensure that the evaluation is meeting the needs of stakeholders.

UFE can be applied in a wide range of evaluation settings, including program evaluations, policy evaluations, and organizational evaluations. The goal is to ensure that the evaluation is relevant, credible, and useful to the intended users, and that it leads to positive change and improvement in the program or organization being evaluated.

Systems Theory #

Systems Theory is an evaluation theory that views programs as complex systems that are made up of interdependent parts. The theory emphasizes the need to consider the context in which programs operate, and to understand the interactions and relationships between program components and external factors.

In evaluation, Systems Theory provides a framework for analyzing the relationships between program components and the broader context in which the program operates. It emphasizes the need to understand the inputs, processes, and outputs of the program, as well as the external factors that may influence the program’s success or failure. These external factors may include economic, political, social, and cultural factors, as well as other programs or interventions that may affect the program being evaluated.

Systems Theory also emphasizes the need to consider the feedback loops and interactions between program components. This includes both the positive feedback loops that reinforce program successes, as well as the negative feedback loops that may lead to program failures. The evaluation should seek to identify and understand these feedback loops, and to use this information to inform program improvement and adaptation.

Systems Theory is useful for evaluations that are complex and multi-faceted, and that operate within a broader context. It helps to identify the interconnections between program components and external factors, and to understand how these factors may influence the success or failure of the program. Systems Theory can be used in a variety of evaluation settings, including program evaluations, policy evaluations, and organizational evaluations, and can be applied to both qualitative and quantitative data.

Empowerment Evaluation Theory #

Empowerment Evaluation is an evaluation theory developed by David Fetterman that emphasizes the participation of stakeholders in the evaluation process, with the goal of promoting learning, capacity building, and empowerment. The focus is on developing the skills and knowledge of stakeholders to participate in the evaluation and to use the findings to make informed decisions.

Empowerment Evaluation involves a collaborative and participatory approach to evaluation, where stakeholders are involved in all stages of the evaluation process. This includes identifying evaluation questions, collecting and analyzing data, and interpreting and using evaluation results. The goal is to build the capacity of stakeholders to participate in and use evaluations effectively.

Empowerment Evaluation involves three key principles:

1. Improvement: The evaluation is designed to promote program improvement and to build the capacity of stakeholders to participate in and use evaluations effectively.
2. Participation: Stakeholders are actively involved in all stages of the evaluation process, and their input and feedback is valued and used.
3. Social Justice: The evaluation is grounded in a social justice framework, which emphasizes the importance of promoting equity, inclusion, and empowerment.

Empowerment Evaluation is useful for evaluations that aim to promote social change and empower communities or organizations. It is often used in evaluations of community-based programs, where stakeholders have a vested interest in the program’s success and are motivated to participate in the evaluation process. Empowerment Evaluation is also used in evaluations of programs that serve marginalized or underrepresented populations, where the goal is to build capacity and promote equity and social justice.

Logic Model Theory #

Logic Model Theory is an evaluation theory that emphasizes the importance of developing a clear and logical framework for program planning and evaluation. The theory emphasizes the need to clearly articulate the inputs, activities, outputs, outcomes, and impact of a program in a logical and coherent way, to facilitate program planning, implementation, and evaluation.

In a logic model, the program’s inputs are the resources that are available to the program, including funding, staff, and other resources. The activities are the program’s interventions, or the actions taken to achieve the program’s goals. The outputs are the direct products or services of the program, such as the number of participants served or the number of events held. The outcomes are the short-term and intermediate-term changes that occur as a result of the program, such as changes in knowledge, attitudes, or behaviors. The impact is the long-term change that occurs as a result of the program, such as improved health outcomes or reduced rates of crime.

The logic model provides a visual representation of the program and the relationships between the program’s components. It helps to clarify the program’s goals and objectives, and to identify the inputs and activities that are most likely to lead to the desired outcomes and impact. The logic model can also be used to guide program implementation and to monitor and evaluate program performance.

Logic Model Theory is useful for evaluations of complex programs or initiatives, where a clear and logical framework is necessary to guide program planning and evaluation. It is often used in program evaluations, policy evaluations, and organizational evaluations, and can be applied to both qualitative and quantitative data.

Realist Evaluation Theory #

Realist Evaluation is an evaluation theory that focuses on understanding how interventions work in different contexts, and for whom, and why. The theory emphasizes the need to identify the underlying mechanisms that explain how and why a program or intervention works, and how these mechanisms interact with the context in which the program operates.

Realist Evaluation Theory is based on the assumption that programs are complex and are influenced by a variety of factors, including the context in which the program operates, the mechanisms that underlie the program, and the interactions between the program and its stakeholders. Realist Evaluation seeks to identify the context-mechanism-outcome configurations that explain how and why a program works or doesn’t work.

Realist Evaluation involves several key steps:

1. Developing program theories: The first step in Realist Evaluation is to develop program theories that explain how the program is expected to work, and under what conditions.
2. Testing program theories: The second step is to test the program theories by collecting data on the program and analyzing it to identify the context-mechanism-outcome configurations.
3. Refining program theories: The third step is to refine the program theories based on the findings of the evaluation, and to identify areas for improvement and further testing.

Realist Evaluation is useful for evaluations of complex programs or interventions, where a clear understanding of the mechanisms that underlie the program is necessary to identify the factors that contribute to the program’s success or failure. It is often used in evaluations of health interventions, social programs, and education programs. Realist Evaluation can be applied to both qualitative and quantitative data, and can be used to inform program design, implementation, and evaluation.

Conclusion on Evaluation Theories #

The selection of an evaluation theory depends on the program being evaluated, the stakeholders involved, and the evaluation goals and objectives.

• “A program evaluation theory is a coherent set of conceptual, hypothetical, pragmatic, and ethical principles forming a general framework to guide the study and practice of program evaluation.“
  Stufflebeam and Shinkfield (2007:63).
• “Theories provide guidance in determining the purposes for evaluations, as well as in defining what we consider to be acceptable evidence for making decisions in an evaluation” Mertens and Wilson (2012:37)
  
• However, evaluation theories are not really theories per se. Stufflebeam and Shinkfield (2007:68) stated “The evaluation profession…has far to go in developing overarching, validated theories to guide the study and practice of program evaluation…(references to theory) usually denote as conceptual approaches or evaluation models that lack the comprehensiveness and validation required of sound theories”.
  

Evaluation theory explains the “why”. An approach offers guidance to an evaluator; describes her role in the evaluation (its prescriptive); and informs decision-making during the evaluation. Thus, its a way of implementing a theory in practice, see Patton’s 17 steps in UFE.

These are just a few examples and definitions of evaluation theories. Other theories include the Diffusion of Innovation Theory, Evaluation Capacity Building Theory, and Cultural Competence Theory.

Each theory has its own strengths and weaknesses but all can be used to inform decision-making. Theories differ according to their assumptions on value, use, and role of evaluation. However, differing perspectives should not be understood as exclusive of each other, rather as complementary, since all theories address elements of the evaluation practice just like a mosaic. Hence, a full understanding of their differences and similarities is useful and important to draw the whole picture of evaluation. With this in mind, it is important to recognize that any evaluation should be based on the context in which it is being conducted in order to ensure that the most effective approach is taken.