Exam 1 - Evaluation and Outcome Assessment Flashcards

(41 cards)

1
Q

What is evaluation?

A

A systematic method for collecting, analyzing, and using data to examine the effectiveness and efficiency of programs to contribute to continuous program improvement.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

T/F: Health programs are population focused, while health services are on an individual level.

A

TRUE

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is included in the Public Health Social Model?

A
  • Individual
  • Relationship
  • Community
  • Societal
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is the term for biological and personal characteristics and behaviors for the social-ecological model?

A

INDIVIDUAL

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is included in the community part of the social-ecological model?

A

Organization and institutions including schools, workplaces, and neighborhoods

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What is the purpose of evaluation?

A

To measure the effects of a program against goals set for it and thus contribute to subsequent decision making about the program

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What do public health programs aim to do?

A

Prevent or control disease, injury, disability, and death

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Name the five ways that public health programs operate, which has become more complex.

A

1) Socioeconomic
2) Demographic
3) Interpersonal
4) Inter-organizational
5) Fiscal/budgetary restrictions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What does evaluation allow?

A
  • To monitor progress toward the program’s goals
  • To determine whether program components are producing the desired progress on outcomes
  • To permit comparisons among groups, particularly among populations with disproportionately high-risk factors and adverse health outcomes
  • To justify the need for further funding and support
  • To find opportunities for continuous quality improvement
  • To ensure that effective programs are maintained, and resources are not wasted on ineffective programs
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What could be evaluated?

A
  • Direct service interventions
  • Community mobilization efforts
  • Research initiatives
  • Surveillance systems
  • Policy development activities
  • Outbreak investigators
  • Lab diagnostics
  • Communication campaigns
  • Infrastructure-building projects
  • Training and educational services
  • Administrative systems
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

When do you not evaluate?

A
  • There are no questions about the program
  • The program has no clear direction
  • The stakeholders can’t agree on the program objectives
  • There is not enough money to conduct a sound evaluation
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What tracks disease or risk behaviors?

A

Surveillance

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What tracks changes in program outcomes over time?

A

Monitoring

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What seeks to understand specifically why these changes occur?

A

Evaluation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Name the seven types of evaluation.

A

1) Community needs assessment
2) Process evaluation
3) Effect evaluation (Outcome evaluation)
4) Cost evaluations
5) Comprehensive evaluations
6) Meta-evaluation
7) Summative evaluations

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What does “My PECCCS” stand for?

A

My - Meta-evaluation

P - Process evaluation
E - Effect evaluation (Outcome evaluation)
C - Community needs assessment
C - Cost evaluations
C - Comprehensive evaluations 
S - Summative evaluations
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What type of evaluation is performed to collect data about the health problems of a particular group?

A

Community needs (health) assessment

18
Q

Which type of evaluation focuses on the degree to which the program has been implemented as planned and on the quality of the program implementation?

A

Process evaluation

19
Q

The information obtained from a process evaluation is used to do what?

A

Plan, revise, and improve the program

20
Q

What is the Outcome evaluation also referred to as?

A

Effect or impact evaluation

21
Q

What key question does the Outcome evaluation seek to answer?

A

Did the program make a difference?

22
Q

Which evaluation type is done by researchers because it requires expertise in economics?

A

Cost evaluations

23
Q

T/F: Cost evaluations are performed late in the planning and evaluation cycle and are not likely to be available in time to make program improvements or revisions.

24
Q

Which type of evaluation involves analyzing needs assessment data, process evaluation data, outcome evaluation data, cost evaluation data as a set of data?

A

Comprehensive evaluations

25
T/F: Comprehensive evaluations are common.
FALSE | -Comprehensive evaluations are relatively uncommon due to the resources needed to integrate analysis of different data
26
How are meta-evaluations done?
By combining the findings from previous outcome evaluations of various programs for the same health problems
27
T/F: Meta-evaluations are most likely to be done by evaluation researchers.
TRUE
28
When is the summative evaluation done?
At the conclusion of a program to provide a conclusive statement regarding program effects
29
How many steps are there in the CDC's Framework for Program Evaluation in Public Health?
6 steps
30
Name the 6 steps of the CDC's Framework for Program Evaluation in Public Health.
1) Engage stakeholders 2) Describe the program 3) Focus the evaluation design 4) Gather credible evidence 5) Justify conclusions 6) Ensure use and share lessons learned
31
What are the purposes of the framework?
- Summarize the essential elements of program evaluation - Provide a framework for conducting effective program evaluations - Clarify steps in program evaluation - Review standards for effective program evaluation - Address misconceptions regarding the purposes and methods of program evaluation
32
Name the four standards of the CDC's Framework for Program Evaluation in Public Health.
1) Utility 2) Feasibility 3) Propriety 4) Accuracy
33
Who are stakeholders?
People or organizations invested in the program, interested in the results of the evaluation, and/or have a stake in what will be done with the results of the evaluation
34
What is the term for the resources needed to implement the activities in step 2: describe the program?
INPUTS
35
What is the term for what the program and staff do with those resources in step 2: describe the program?
ACTIVITIES
36
What is the term for tangible products, capacities, or deliverables that result from the activities in step 2: describe the program?
OUTPUTS
37
What is the term for changes that occur in other people or conditions because of the activities and outputs in step 2: describe the program?
OUTCOMES
38
What is the term for the most distal/long-term outcomes in step 2: describe the program?
IMPACTS
39
What is the term for contextual factors that are out of control of the program but may help or hinder achievement of the outcomes in step 2: describe the program?
MODERATORS
40
What should gathering evidence include?
Consideration of indicators, sources of evidence (methods of data collection), quality, quantity, and logistics
41
What are the 4 parts of the public health social ecological model?
1) Individual 2) Relationship 3) Community/Aggregate 4) Societal