Evaluation Flashcards

(45 cards)

1
Q

What is process evaluation?

A

Ongoing assessment of intervention implementation, targeting how it is carried out, its reach, and contribution to desired outcomes.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Process evaluation involves a mix of ____ and ____ research methods.

A

Qualitative; quantitative.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

In a nutrition education campaign, exposure is measured by the number of people who received pamphlets. What type of evaluation measure is this?

A

Process

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

How is reach calculated in a school-based intervention?

A

As the percentage of students attending sessions compared to the total number of students.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Fidelity focuses on maintaining the ____ and ____ of the intervention.

A

Quality; consistency.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

A health program measures participant satisfaction using surveys and focus groups. What process evaluation component is being assessed?

A

Satisfaction.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What does context evaluation examine in process evaluation?

A

Social, cultural, economic, and environmental factors affecting intervention success.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is impact evaluation?

A

Assessment of immediate effects of an intervention, such as behavior, attitudes, and awareness changes.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

A nutrition program measures changes in knowledge about healthy eating. Which type of evaluation is this?

A

Impact evaluation.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Outcome evaluation focuses on ____ effects, such as long-term changes in health behaviours or conditions.

A

Longer-term.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

How might a community-based nutrition intervention evaluate its long-term success?

A

By measuring actual increases in fruit and vegetable consumption over time.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

List the five timing effects in evaluation and explain their significance.

A
  1. Ideal effects: Immediate and sustained improvements.
  2. Sleeper effects: Delayed impacts.
  3. Backsliding effects: Short-term change followed by regression.
  4. Trigger effects: Accelerated behavior change.
  5. Backlash effects: Negative consequences after the intervention.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

A researcher conducts repeated measurements over time on a single group to track changes. What evaluation design is this?

A

Single group time-series.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

A randomised control trial (RCT) involves ____ allocation of participants to intervention and control groups.

A

Random.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What is a key strength of non-equivalent time-series design?

A

It strengthens evidence by comparing repeated measurements between intervention and control groups.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What are the challenges in evaluating capacity gains?

A

Dynamic contexts, multiple definitions, invisibility of capacity-building, and attribution of changes.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

A health initiative uses participatory processes to engage stakeholders in evaluation. What strategy is being applied?

A

Incorporating participatory processes.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Mixed methods in evaluation involve combining ____ and ____ techniques.

A

Qualitative; quantitative.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

How can trustworthiness in capacity evaluation be enhanced?

A

Through transparency, triangulation of data, and ethical considerations.

19
Q

What is economic evaluation?

A

A method to compare interventions by analyzing their costs and consequences to determine cost-effectiveness.

20
Q

For economic evaluation to be meaningful, an intervention must first prove its ____.

A

Effectiveness.

21
Q

What does cost-utility analysis measure?

A

Outcomes in terms of quality-adjusted life years (QALYs) or disability-adjusted life years (DALYs).

22
Q

A public health program is compared to another to find the lowest cost option with identical outcomes. What type of economic evaluation is this?

A

Cost-minimization analysis.

23
Q

What is reflective practice?

A

A structured process of analyzing one’s experiences to gain insights and improve future performance.

24
Types of reflective practice include ___ and ___.
On action; in action.
25
A practitioner keeps a journal to critically evaluate the effectiveness of their interventions. What reflective practice tool is being used?
Reflective journaling.
26
What is valorisation in health promotion?
Sharing knowledge and lessons learned from interventions with a broader audience to ensure sustainability and impact.
27
Valorisation can involve sharing findings through ____, ____, or creative formats.
Written reports; presentations.
28
A project shares its results with policymakers and stakeholders to encourage program continuation. What strategy is this?
Valorisation.
29
Process Evaluation:
Focuses on assessing intervention implementation, operation, and its contribution to outcomes. Uses qualitative and quantitative methods. Key components: - Exposure: Measures how many people engage with materials (e.g., pamphlets distributed). - Reach: Percentage of target audience participating (e.g., students attending sessions). - Satisfaction: Captures participant feedback via surveys, interviews, and focus groups. - Delivery: Checks whether the intervention is implemented as planned. - Fidelity: Ensures consistency and quality (e.g., correct use of materials). - Context: Examines external factors like social, cultural, and economic influences.
30
Impact evaluation:
Assesses immediate effects of the intervention, such as changes in behavior, attitudes, or awareness.
31
Outcome evaluation:
Focuses on longer-term effects aligned with intervention goals. Example: A nutrition program measuring knowledge changes (impact) and increased fruit/vegetable consumption (outcome).
32
Timing of Evaluation - Different effects occur over time:
Ideal effects: Immediate, sustained improvements. Sleeper effects: Delayed impact. Backsliding effects: Temporary improvement followed by regression. Trigger effects: Accelerated behaviour change. Backlash effects: Negative consequences post-intervention.
33
Single Group Post-Test Only:
Collects data after intervention; lacks comparison.
34
Single Group Pre & Post Test:
Measures changes before/after intervention; influenced by external factors.
35
Non-equivalent Control Group Pre & Post Test:
Compares intervention and control groups; lacks randomisation.
36
Single Group Time-Series:
Repeated measures over time; subject to external influences.
37
Non-equivalent Time-Series:
Measures intervention/control repeatedly to strengthen evidence.
38
Randomised Control Trial (RCT):
Gold-standard; random allocation to intervention/control groups, robust for causation evidence.
39
Challenges in measuring capacity:
Ambiguity in terms and definitions. Invisibility of capacity-building. Dynamic contexts and sensitivity of issues. Attribution for change.
40
Strategies to address challenges in evaluating capacity gains:
Use participatory processes. Combine qualitative and quantitative methods. Build trust and establish validity/reliability. Be flexible and acknowledge the dynamic nature of health systems.
41
Purpose of economic evaluation:
Compare interventions based on cost and outcomes to inform resource allocation
42
Types of economic evaluation:
1. Cost-minimisation analysis: compares identical outcomes for lowest cost 2. Cost-effectiveness analysis: quantifies effects like behaviour change eg. BP, F+V intake 3. Cost-utility analysis: uses QALYs/DALYs to assess QoL 4. Cost-benefit analysis: measures all outcomes in monetary terms to assess cost-benefit balance
43
Reflective practice in evaluation:
Analyses experiences to gain insights for improvement. Types: “On action” (post-event reflection). “In action” (real-time reflection). Tools: Journals, structured questioning, discussions with peers.
44
Valorisation in evaluation:
Sharing intervention outcomes to ensure sustainability and wider impact. Formats: Reports, presentations, creative methods. Emphasises transparency and learning from failure.