Pop Health Definitions Flashcards
(46 cards)
Evaluation
Systematic investigation of merit/worth/significance of object or effort
Program
Object or effort being evaluated
Program evaluation
Way to evaluate the specific projects and activities community groups may take part in
Stakeholders
Those who care about the program or effort (or those presumed to benefit)
What to ask when evaluating a program?
- What will be evaluated?
- What criteria will be used to judge performance?
- What standards must be reached for it to be successful?
- What evidence will we use?
- What conclusions are justified based on the evidence?
Questions to ask when evaluating OUTPUTS?
Did you do what you set out to do? Reach the number of people you expected to? Use the methods you intended? Provide the kind of service you planned for?
Questions to ask when evaluating OUTCOMES?
What were the results of what you did? Did what you hoped for take place?
A logic model does what?
It synthesizes the main program elements into a picture of how the program is supposed to work. Spells out the sequence of events that are supposed to bring about change.
Are logic models used for new or existing programs? ?
Both new and existing.
Do you use logic models during planning, implementation, orientation, advocacy or evaluation?
All of the above.
Program management
A decision-making system similar to the nursing process
-it’s applied to programs and consists of Assessment, Planning, Implementation and Evaluation
What does ADPIE look like in program management?
Assess the needs/strengths/weaknesses of a population
Diagnose: prioritize health needs
Plan interventions to meet outcomes
Implement: carry out the plan and monitor the process
Evaluate: examine success and outcomes.
Formative Evaluation
Takes place during the planning, process, implementation of a project.
Also called “process evaluation”
Summative evaluation
Evaluates the outcome of a particular program.
Also called “Impact” evaluation
What does PDSA stand for? When would you use it?
Plan-Do-Study-Act
You use it to make small, incremental improvements over time in a program. Typically focuses on one small aspect of the program to change.
Spell out what the steps of PDSA are
Plan: plan the test/observation, including how you’ll collect data
Do: try out the test on a small scale
Study: analyze the data and study the results
Act: refine the change based on what was learned.
What are the different columns in a Logic Model?
Resources (everything you’re putting into it: money, people, etc)
Activities (training and outreach you’ve planned)
Outputs (training and outreach you do)
Outcomes (the facts/data that you’re seeing after implementation)
Impact (the impact of those facts/data)
What is participatory evaluation?
A lengthy, involved evaluation process that involves every stakeholder in a project. The goal is to evaluate the process from everyone’s point of view and use the information retrieved to improve the work.
Steps in conducting a participatory evaluation?
- Find and train stakeholders.
- Name and frame the issue
- Develop logic model to address it
- Decide what questions to ask/how to ask them
- Collect information on the intervention and its effects
- Analyzing the data
- Use the information to celebrate and make changes to the project
Contextualism
Embedding interventions into local circumstances
Collecting info in a participatory evaluation - how?
Research into data/records
Interviews, Focus groups, sharing sessions
Surveys
Direct observation
What three areas should information-gathering and analysis cover in participatory evaluation
Process
Implementation
Outcomes
What does it mean to analyze the process (in evaluation)? What questions would you ask?
Was there good coordination/communication?
Was it participatory?
Was the timeline realistic?
Were you able to find/hire the right people? Did they do what they were expected to do?
What does evaluating the outputs look like in participatory evaluation? What questions would you ask?
Did you do what you set out to do?
- reach the number of people you expected to?
- provide the amount/kind of service you planned for?
(NOT whether it was effective. Just if you actually carried it out as planned).
