Mixed Methods 2 Flashcards
What is evaluation research?
Applied research conducted in real-world settings, which helps the psychology professional determine what programs work and for whom.
- Used when trying to decide ‘what works’*
- To evaluate whether a research method works, or a survey works etc.*
Evaluation research depends on the 1)_____
Evaluation happens in a series of 2)_____
There are different types of 3)_____
All that’s needed for MCQ’s - understand these concepts
1) question at hand
2) stages
3) evaluation
What are the three types of evaluation?
1) Process evaluation
2) Impact evaluation
3) Outcome evaluation
When writing a proposal, what are the questions you need to ask in relation to or all three types of evaluations (process, impact and outcome)?
1) What is the research question?
2) What type of variables would you need to consider?
3) How would you collect the data?
Where is evaluation research usually done?
Complex sociopolitical circumstances and there are multiple stakeholders (which may have conflicting views in the outcomes)
Evaluation research often uses relatively ____ designs
simple
(however, higher level designs such as randomised trials can be applied)
What is process evaluation trying to answer?
Is the intervention being used the way that it is intended?
What is impact evaluation trying to answer?
What are the immediate effects?
What question is outcome evaluation trying to answer?
What are the ultimate effects?
Evaluation is usually conducted in 3 stages.
Describe the three stages of evaluation.
Process evaluation: is the intervention being used the way that it is intended?
Impact evaluation: what are the immediate effects?
Outcome evaluation: what are the ultimate effects?
When doing evaluative research, how do you make an assumption if you don’t have a control group?
E.g. how do you know if a program is working to reduce depression.
Compare groups who have less visits compared to those who have more.
Simple design
What is acceptance commitment therapy?
A type of cognitive behaviour therapy that blends with the values of the individual and helps them accept the situation as it is and themselves to use that as a catalyst to change.
(Rather than just pure cognitive behaviour therapy where it’s about a change of mindset)
Designed to enhance psychological flexibility (flexible thinking)
For process evaluation for the farmer’s study:
Explain the research question, variables and data collection for the farmer website example (where they are trying to see if the website is working)
Research question: Are farmers using the website? What part of the website are they accessing the most and least
Variables: Visits to the site; number of unique visits to the site; number of pages visited; average number of pages accessed per visit; mean time spent on site
Data collection: Google analytics
For impact evaluation for the farmer’s study:
Explain the research question, variables and data collection for the farmer website example (where they are trying to see if the website is working)
Research question: What is the immediate reaction to the website
Variables: Perceived impact on psychological health and wellbeing (coping strategies, readiness to seek personal and professional support, ability to think positively and flexibly.
How would you rate the website? How well do you think the website…?
Data collection: Purpose designed and pre-existing questionnaires and interviews
For outcome evaluation for the farmer’s study:
Explain the research question, variables and data collection for the farmer website example (where they are trying to see if the website is working)
Research question: Does using the website increase psychological wellbeing?
Variables: Psychological flexibility, as conceptualized within Acceptance and Commitment Therapy (ACT)
Data collection: Pre-existing questionnaires: Acceptance and Action questionnaire
