Process Evaluation Flashcards
(30 cards)
What is process evaluation?
A method of assessing how and why an intervention works, not just whether it works.
Name three core components of process evaluation according to Moore et al. (2015)
- Understanding complex interventions
- Developing and refining interventions
- Testing feasibility for real-world applications
What does “implementation” refer to in process evaluation?
How the intervention was actually delivered VS the what was planned.
What is “context” in process evaluation?
External factors that influence the intervention’s:
- Theory
- Implementation
- Outcomes.
What are “mechanisms of impact”?
- How and why the intervention produces change.
- factors that explain the relationsip between treatment and outcome
What is intervention fidelity? (faithfulness)
The degree to which an intervention is delivered as planned.
Name two ways to measure intervention fidelity.
- Recording therapy sessions
- Comparing delivery to intervention manuals.
What is meant by the “dose” of an intervention?
The amount (e.g., number and length of sessions) and intensity of intervention delivered.
Why is fidelity important in evaluating interventions?
It helps distinguish between intervention failure and implementation failure.
What is an example of a mechanism of impact in a health behaviour intervention?
- Change in attitudes
- Increase in knowledge
- Change in behaviours
What are two characteristics of complex interventions?
- They are multi-component
- tailored to individual needs.
Why can’t we assume outcomes alone tell us if an intervention was successful?
- we can’t tell whether results are due to the intervention itself or external factors.
What is the risk if we don’t assess context in an intervention study?
We might wrongly attribute success or failure to the intervention without recognising external influences.
According to Craig et al. (2008), what framework provides guidance for evaluating complex interventions?
The MRC Framework.
Why is stakeholder involvement important in intervention design?
It ensures the intervention is relevant, practical, and more likely to be accepted by users.
In the CHErIsH study (Toomey et al., 2020), who were the two key stakeholder groups?
- Healthcare professionals (HCPs)
- parents.
Why is using mixed methods important in process evaluation?
It provides a richer, more complete understanding of how the intervention worked.
Give an example of a contextual factor that might affect an intervention’s success.
- Socioeconomic conditions
- Organisational support
How does measuring mechanisms of impact help improve future interventions?
It identifies which processes are most important in driving behaviour change.
What might indicate that an intervention failed due to POOR IMPLEMENTATION rather than poor design?
- fidelity and dose are low
- intervention theory remains strong.
Explain how LOW FIDELITY in intervention DELIVERY could falsely suggest an intervention is ineffective.
- If fidelity is low, the intervention was NOT delivered as designed
- means poor outcomes may be due to DELIVERY ISSUES rather than the intervention itself.
Why might high intervention fidelity not always guarantee positive outcomes?
Even if delivered perfectly, the intervention’s core theory may be flawed or not applicable to the context.
Why do we measure “mechanisms of impact”
- By examining what changed during the intervention
- we can detect expected benefits and unexpected side effects or harms.
Why is it important to measure dose and fidelity separately in process evaluation?
- A high number of sessions (dose) does not guarantee content quality (fidelity), and vice versa
- both aspects influence outcomes differently.
