3. empirically supported tx: research methods + evidence based Flashcards

RCT steps to empirically evaluate psychotherapy, past and present definitions of ESTs

1
Q

what are the 4 methods of evaluating psychotherapies

A
  1. case studies
  2. naturalistic studies
  3. quasi-experiments
  4. RCTs
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

in what context would it be best to use a case study?

A

best when studying completely new therapies

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

what are naturalistic studies? pros? cons?

A
  • over long period of time
  • usually with same patient
  • con: usually the same people
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

what is quasi-experiment, and what is it usually used for?

A
  • not a complete experiment
  • comparing 2 experiments or tx
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

what does RCT stand for, what are their origins, what’s it used for?

A
  • randomized controlled trials
  • adopted from medicine
  • used to determine cause and effect
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

name the 7 steps of RCT testing

A
  1. develop protocol
  2. choose comparison to tx of interest
  3. select participants of interest
  4. random assign participants to conditions
  5. administer tx and assess fidelity
  6. evaluate outcomes at end of tx
  7. evaluate outcomes at follow up time points
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

developing the protocol…

what are the 2 questions you need to ask yourself when developing the protocol?

A
  1. what is the tx? (what’s the model? what’s the tx technique?)
  2. how will it be administered? (is it standardized?)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

what are the 3 types of comparison txs?

A
  1. waitlist
  2. supportive psychotherapy
  3. CBT (gold standard)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

what is the difference between CBT and supportive psychotherapy?

A

support implies building a relationship w the patient as a baseline. usually includes just conversational therapy. CBT is the tested therapy in which there’s a little sprinkle sprinkle

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

what are the 2 things you need to consider when selecting participants?

A
  1. balancing concerns with internal and external validity
  2. finding participants that are representative of the population to which it’ll be generalized
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

what is internal validity?

A

quality of experimental design and control for extraneous factors

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

what is external validity?

A

will the results be generalizable?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

what are the 2 factors that usually prevent researchers to have representative samples when selecting participants?

A
  1. demographic factors (usually causasion undergrads)
  2. comorbid dx (usually ask for non-comorbid)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

why do we need random assignment?

A

minimizes pre-existing differences between groups that could affect the outcome

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

difference between single blind and double blind

A

double blind: both part and exp don’t know who gets what
single blind: part doesn’t know if they’re getting tx, exp knows

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

explain how to administer double blind experiment in the context of psychotherapy

A

… u can’t. lol.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

what is a fidelity check? what is it used for?

A

fidelity checking is to make sure that the tx is administered adequately. researchers will use recordings and rate how well it’s being administered

18
Q

what’s the biggest influence that could alter how a tx is being administered in the context of psychotherapy?

A

individual therapist factors

19
Q

what kind of validity is being ruptured if the therapists aren’t administering the tx as outlined?

A

internal validity

20
Q

how do you evaluate the outcome of a tx? on a px

there are 4 ways

A
  1. no longer meeting the DSM dx criteria
  2. decrease in target sx (not necessarily a full recovery)
  3. decrease in comorbid sx
  4. increase in functioning
21
Q

what are 4 ways to evaluate the success of your tx?

A
  1. statistical significance
  2. effect size
  3. therapist and site effects
  4. people who drop out
22
Q

what 2 things influence statistical significance?

A
  • magnitude of effect
  • sample size
23
Q

what is an effect size?

A

magnitude of difference, independent of sample size

24
Q

what’s the formula for Cohen’s d?

A

d = (x1-x2)/Sp

d = cohen’s d
x1 = mean exp
x2 = mean contr
Sp = SD of control group

25
Cohen's *d*: what is a small, medium, large effect?
small: 0.2 medium: 0.5 big: 0.8 | it can go over 1
26
how much change is needed for clinical significance?
relative to what we're studying | ex: if it's suicide attempts? anything. lol.
27
what are site effects?
results can be different based on location in which tx is administered
28
what do we do if people drop out? what are some assumptions we can have? what do we do, statistically?
perform intention-to-treat analyses | did they get better before the end? did it not help?
29
two things that can happen once tx stops?
1. relapse 2. sleeper effect
30
what's the sleeper effect?
during tx, might not see any improvements. after tx, continue to do better (concept of consolidation during sleep)
31
according to the DeRubeis et al study, what was the conclusion drawn about psychological tx and medication?
psychological tx was more enduring than meds
32
why might some people relapse after tx?
during tx, you're continuously held accountable, learning new skills, practicing said skills. after, all the accountability stops.
33
what's one element that needs to be in the report of an RCT? | i usually skip these when skimming research articles lol
CONSORT flow diagram
34
what's in the flow diagram? | 4 questions
* who's in the study * what happened to them * how well was it designed * is something wrong with the design the last two are the same tho so cut urself some slack
35
what did the first ever meta-analysis conclude? | Smith + Glass 1977
typical therapy client was better than untreated clients
36
what does EST stand for?
empirically supported tx
37
what were the criteria that the chambless & hollon article imposed for *well established tx*?
minimum 2 "good" between group designs that show tx better than meds, psychotherapy, or other tx OR equivalent to established tx OR bunch of single case designs with good exp design and comparison to other tx AND conducted with tx manuals or other clear descriptions characteristics of sample must be clearly defined effects must be demonstrated by min 2 different investigators or teams
38
# according to chambless & hollon what's a *probably efficacious tx*?
* 2 exp show tx is better to waitlist control OR * 1 or more exp meet criteria but have not been replicated by independent investigators OR * small series of single case design experiements have been conducted
39
what were tolin's critiques of chambless & hollon?
1. eval based on 2 studies is too low of a bar 2. focus is on sx reduction 3. no guidance on which EST to choose
40
# which is better: meta-analysis or single case study?
meta-analysis
41
# which is better: RCT or single case study?
RCT
42
what's the difference between a **strong** and a **modest** tx?
strong: well established modest: probably efficacious