Flashcards in Chapter 7 Deck (44):
A diligent investigation of a program's characteristics and merits.
Individuals, groups or organizations that can affect or are affected by an evaluation process and/or its findings.
This provides credible and relevant information concerning a program's theoretical framework, design, activities, and operation.
This provides credible, valid information concerning the program's outcomes, impact, and effectiveness.
Evaluations tend to be conducted around 5 main focus areas:
Theories that explain the cause and effect links between the problems, program activities, and outcomes.
Focus on the long-term effects of a program or process, establishing cause and effect relationships between the program and the outcomes or changes in the social problem or need.
Assess the immediate effects of a program or process on the target population and typically measure the achievement of program objectives.
Used to examine the costs and benefits of programs in terms of quality of their operations and the outcomes they produce.
The main objective of _______ ________ is to provide stakeholders with information that leads to a deeper understanding and working definition of the social problem or need.
This focuses on working with stakeholders to construct a clear description of how a program is intended to work.
Program theory evaluation
This provides information on the actual operation of the program.
Program implementation evaluation
This involves the identification of key outcomes, and the systematic practice of collecting data to inform the stakeholders of the program's effectiveness in reaching these outcomes.
______ ______ attempt to measure program effects and have a summative purpose.
This focuses on the merit or worth of a program from the standpoint of its financial benefits and costs.
program efficiency evaluation
This advocates the use of different approaches to evaluation based on important information such as the nature of the program being evaluated, the context of the evaluation, the informational needs and intended use of the evaluating results by stakeholders, programmatic resources, and the specific evaluation questions.
What are the approaches to Program evaluation?
Appreciative Inquiry (AI) approach
This approach emphasizes the determination of the achievement of stated goals and objectives in the program design.
Some models that emphasize objectives approach are:
Metfessel and Michael's Evaluation Paradigm
This approach includes examining program objectives as well as looking beyond programmatic outcomes and views the informational needs of managers as a critical aspect of evaluation.
Referred to as formative evaluation, this assesses, analyzes and documents the development and implementation of a program or strategy to determine if the program activities were conducted as planned
This approach uses language or narrative as raw data in order to study people's thoughts, experiences, and perspectives.
This approach uses numbers as raw data in order to test hypotheses and establish cause-effect relationships.
This approach emphasizes the formative purpose of evaluation. Considers information needs of all stakeholder groups.
Examples of participatory approach include _______ ________, ________, and _________ evaluations.
Utilization Focused, Responsive, and Empowerment
The premise of this is that the results of evaluative processes should be judged by their utility, usability, and use or actual application of the findings.
This approach focuses on organizational and program assets as opposed to the identification of problems and deficits.
Appreciative inquiry (AI) approach
What are the 5 principles of AI approach?
acceptance that multiple realities exist
inquiry and change are simultaneous and therefore inquiry is intervention
organization or program is continuously authoring its own story and can take the plot line in any direction at any time
image an organization or program has about its future guides its current actions
focusing on positive experiences, participants become more motivated, inspired and engaged
The most common method for conducting AI approach.
4D model (Discovery, Dream, Design, and Destiny)
Observable and measurable milestones toward an outcome target
Quantitative approaches fall into these three broad categories:
This involves participants serving as their own controls. Evaluation measures are gathered on participants before and after the intervention program.
This compares two groups. The group that is receiving the intervention is matched to a population that is similar demographically but is not receiving the program.
This randomly assigns people to two groups. One group receives an intervention and the other does not. Data collected from both groups.
Ways to collect qualitative data:
Interviews, focus groups, observation, and review of documents.
Refers to using evaluation results to inform action.
Refers to the impact of evaluation processes on decision makers' thought processes about a current or future program.
Occurs when cognitive and behavioral changes result as a function of participating in the evaluation process