Research Methods Flashcards
(110 cards)
1
Q
the belmond report 3 principles
A
- respect: informed consent, special groups protection
- justice: right balance between the people that benefit from the research and the people that participate in it
- beneficience: participants should be protected from harm and ensured well being. ook confidentiality hoort hierbij.
2
Q
APA 5 general principles
A
- respect
- beneficience
- justice
- fidelity and responsibility (trust, professional)
- integrity (accurate info, honest)
3
Q
deception through omission
A
witholding info
4
Q
deception through comission
A
lying
5
Q
difference data fabrication and data falsification
A
- Data fabrication: Inventing data to fit the hypothesis
- Data falsification: Influencing a study’s results
6
Q
3Rs from animal research
A
replacement (liever een andere methode), refinement (minste distress), reduction (zo min als mogelijk dieren)
7
Q
interaction effects
A
when the original independent variable depends on the level of another independent variable
8
Q
spreading interaction
A
an interaction between two independent variables “only occurs when..”
9
Q
moderator
A
independent variable that changes the relationship between the independent and dependent variable
10
Q
factorial design 2 effects
A
main and interaction effects
11
Q
interaction effects wanneer ?
A
als de lijnen parallel zijn: GEEN interactie effect. anders wel.
12
Q
factorial variations
A
- Independent-groups factorial designs: Both independent variables are studies as independent groups (E.g.: in a 2×2 factorial design, there are four different groups of participants in the experiment)
- Within-groups factorial designs: Both independent variables are manipulated as within-groups (E.g.: in a 2×2 factorial design, there is only one group of participants, but they participate in all four combinations of the design)
- Mixed factorial designs: One independent variable is manipulated as independent-groups, and the other is manipulated as within-groups
13
Q
three way design
A
- Results in three possible main effects
- Results in three possible two-way interactions
14
Q
three way interaction
A
Three-way-interactions: A two-way interaction that depends on the level of the third independent variable
15
Q
obscuring factor
A
hierdoor kan je geen relatie zien tussen independent and dependent variable
16
Q
internal validity
A
zijn er andere factoren die een rol spelen?
17
Q
design confound
A
andere explanation omdat het studie design gewoon niet goed is
18
Q
selection effects
A
the participant groups are systematically different
19
Q
order effects
A
the order in which the interventions are presented lead to differences: participants get tired etc.
20
Q
maturation threat
A
spontaneous remission (behaviour just changes)
21
Q
history threat
A
a factor unrelated to the study influences the outcome for the whole group (COVID)
22
Q
regression to the mean
A
when a group has an extreme value as mean, it is most definitely going to be less the next time.
23
Q
attrition threat
A
drop out
24
Q
testing threat
A
participants scores change when they take a test multiple times
25
instrumentation threat
the instrument changes -> measures differently
26
observer bias
researchers expectation have influence
27
demand characteristics
participant knows what the study is about
28
null effect
gewoon geen effect
29
between group obscuring factors
- weak manipulation -> door slechte study design geen goede manipulatie (manipulation check!)
- insensitive measures (door slechte measures kan je geen verschil meten tussen de groepen)
(- ceiling effect: all scores clustered at the end, te makkelijk)
- floor effect: all scores clustered at the bottom, te moeilijk)
30
dus obscuring factors van verschillen zijn ...
within group issues. de grafieken liggen dan verder uit elkaar.
31
within group issues of obscuring factors
- Noise: Unsystematic variability
- Measurement error: A human or instrument factor that can inflate or deflate a person’s true score on the dependent variable
- Individual differences (use within group design to solve this, or more participants)
- Situational noise: External distractions (control wat je kan controleren, anders randomiseren)
32
strengths of within groups
control for individual differences
fewer participants needed
33
strength of between group design with more than one independent variable
- two for the price of one
- you can study interaction effects
maar (-) wel 2x zoveel participanten nodig.
34
hoe kan je zien of er een 3 way interactie is
als de twee grafieken hetzelfde zijn voor verschillende locaties bijvoorbeeld -> dan geen interactie effect. als ze ander zijn is er wel een interactieeffect.
35
participant variables
variables that you do not manipulate. these are also called additional independent variables.
36
mixed factorial design
manipulate one independent variable between subjects and another within subjects.
For example, a researcher might choose to treat cell phone use as a within-subjects factor by testing the same participants both while using a cell phone and while not using a cell phone (while counterbalancing the order of these two conditions). But he or she might choose to treat time of day as a between-subjects factor by testing each participant either during the day or during the night (perhaps because this only requires them to come in for testing once). Thus each participant in this mixed design would be tested in two of the four conditions.
37
within-group design
pretest -> intervention -> posttest. in the same group
38
voorbeeld van regression to the mean
mensen die zich depressief voelen zullen zich de volgende keer waarschijnlijk minder depressief voelen, aangezien ze zich aanmelden voor therapie op hun laagste punt. daardoor wss beter de next measurement.
39
mixed factorial design
pretest -> intervention -> posttest
pretest -----------------------> posttest
40
non-specific effects
effects not due to the treatment, but due to the expectation of being treated (bijvoorbeeld meer gaan sporten door motivatie therapie)
41
wat is een oplossing voor non-specific effects
mixed factorial design with control group on a waitlist
42
differences non-specific effects and placebo effect
non-specific: differences because you think you will be treated
placebo: because you are being treated
43
hoe doen ze vaak control condition bij psychological interventions
positive control group: kijken of de interventie beter is dan de traditionele interventie.
44
difference observer effect and observer bias
Observer bias: The researcher may see differences between the conditions that are not actually there
Observer effect: The researcher may treat participants differently depending on the condition they’re in
45
demand characteristics
The participant may have the tendency to behave according to the research hypothesis
46
hoe non-specific effects meten
door waiting list controls met controls te vergelijken
47
hoe meet je placebo effect
negative controls vs waitlist control
48
attrition
drop out, problematic if it is in one condition
49
testing
the effect of being tested twice (oplossing: control group of alleen posttest).
50
instrumentation
door instrumenten. oplossing: control group of alleen posttest.
51
small n reasons
- rare condition
- homogenous population (fridges)
- everyone has different symptoms -> everyone is a new experiment
- you need to know within-subject differences for psychological disorders.
52
small n vs large n
small n = differences between individuals. large n is differences within population
53
3 small n designs
- stable baseline design
- reversal design
- multiple baseline design
54
stable baseline design
[M1 M2 M3] T [M4 M5 M6]
55
stable baseline design waar controleer je voor en waar niet voor
* Solves the measurement problem
* Accurate estimate of individual parameter
* Controls for some internal validity threats
* Maturation
* History
* Non-specific effect
* Regression to the mean
niet: placebo of non-specific effects?
56
reversal design
you run consecutive sessions of the same condition until stable, and then you switch to another condition. if the behaviour differs between control and testing phase, the effect can be attributed to the treatment.
57
multiple baseline design
study the effect of the intervention on multiple variables.
58
when quasi experiment
if experiment is...
unethical
unpractical
unnatural
impossible
59
quasiexperiment kenmerken
geen randomisatie, en niet dubbelblind. maar een groep deelnemers die interventie ondergaat wordt vergeleken met een groep die geen interventie ondergaat. the manipulation is an already scheduled event, therefore the researcher is not in control (bv plastische chirurgie).
60
power =
rejecting the H0 when it is indeed not the correct hypothesis.
61
difference substantive and statistical hypothesis
sustantive: hypothesis about how the world works.
statistical: statement about a population parameter
62
reject H0 if..
your data is not likely if H0 is true
63
not reject H0 if
your data is likely if H0 is true
64
p-value
probability of these or more extreme results if H0 is true
65
test statistic
how far the point estimate falls from the parameter value in the null hypothesis
66
p-value bij two tailed test
the probability on these or extremER results if the H0 is true
67
proportion assumptions
* Variable is categorical
* Data are obtained using randomization (random sample or random assignment)
* Sampling distribution of proportion is normal if np ≥ 15 and n(1-p) ≥ 15
68
p-value bij <
gewoon zo
69
p-value bij >
1- ...
70
*
Conclusions
from a two sided significance test will agree with
conclusions drawn from a confidence interval
*
e.g.,: a significance test with a significance level of 0.05 will produce
the same conclusions as a 95% confidence interval
*
e.g.,: a
significance test with a significance level of 0.01 will produce
the same conclusions as a 99% confidence interval
oke
71
type 1 error
H0 gets rejected when it is right
72
type II error
H0 does not get rejected when it is false
73
power =
1- type 2 error
74
wat doe je bij het vergelijken van 2 verschillende groepen obv means
H0 : u1 - u2 = 0
Ha: u1-u2 =/= 0
75
standard error =
=s = the estimated standard deviation of the sampling distribution
76
df with two independent groups
is we can assume that s1=s2; then df = n1 + n2 - 2
77
hoe t value krijgen uit df
t.inv
78
95% CI bij twee groepen =
x1 - x2 +- t0,025*se
79
a 95% CI means that ...
that in the long run,
95% of your confidence intervals will include the true parameter value
80
observational study
compare the results of one group to a standard
81
a sampling distribution for 2 proportions is normal when....
n 1 p 1 ≥ 10 and n 1 (1 p 1 ) ≥ 10 in group 1 and if n 2 p 2 ≥ 10 and n 2 (1 p 2 ) ≥ 10 in group 2
82
a sampling distribution for 2 proportions is normal when....
n 1 p 1 ≥ 10 and n 1 (1 p 1 ) ≥ 10 in group 1 and if n 2 p 2 ≥ 10 and n 2 (1 p 2 ) ≥ 10 in group 2
83
dus het verschil tussen 1 proportion en 2 proportions between independent groups:
de assumptie over normale verdeling:
1 proportion = normally distributed if n*p > 15
2 proportions = normally distributed if n1*p1 > 10
(3 for two sided test: n*p >5)
(two proportions has a smaller necessary assumption than 1)
84
if the interval contains 0...
the proportions/means do not differ significantly
85
assumptions for two proportions in 2 sided test
n*p => 5!
86
hoe bereken je ^p voor 2 proporties
= overall passed/n1 + n2
87
𝑥̅𝑑 berekenen: in welke sample en hoe?
in matche-pairs of repeated measures.
alle scores van elkaar aftrekken en daar het gemiddelde van nemen (x1 - x2 etc).
88
wat is n bij dependent samples
aantal paren!!!!!!!!!!!!!!!!!!!!!!!!
89
wanneer mcnemar's test
bij dependent samples: proportions
90
assumptions of mc nemars test
- categorical variables
- the sum of the frequencies is at least 30
fomule -> z score -> p value
91
wat te doen bij 2 categorical variables...
contingency table!
92
conditional proportion
the proportion of the response variable, for one level of the explanatory variable
93
what is independence for conditional proportions
independence: a response variable is independent of the explanatory variable (no association!) if the conditional proportions are the same.
94
what is dependence for conditional proportions
dependence: a response variable is dependent of the explanatory variable (association) if the conditional proportions are different
95
assumptions for when both variables are categorical: strength of assocication
- categorical
- random
- each cell has 5 expected counts
96
hypotheses for 2 categorical variables: strength of association
H0: the variables are independent
Ha: the variables are dependent
97
what does the H0 of cat ass imply?
that P(A and B) = P(A) * P(B) (want multiplication rule for independent H0!) events.
If H0 is true, then P(A and B) = P(A) * P(B)
98
table maken expected by H0
1. proportions normaal aan de RANDEN (deel/totaal!)
2. middelste cellen: rand x rand
3. alle getallen x n -> zodat je de expected frequencies hebt ipv proportions.
(assumption: if any of these variables is < 5, the test should not be performed).
dus....
expected frequency = (row total x column total)/total n
99
chi square test voor...
determining how much the observed and expected values differentiate from each other.
100
x2 distribution
- always positive
- df = (rows -1) *(columns -1)
- mean = df
- two sided always
- large x2 = evidence against independence = H0 is rejected (large x2 = association likely)
101
hoe van p value naar x2 value
chisq.inv(0,95;df)
102
hoe van x2 naar p value
chisq.dist (voor links), 1-chisq.dist (voor rechts) -> automatisch voor two sided, dus nooit x2!
103
difference between x2 and statistical test
large x2 implies strong evidence against H0, pvalue says nothing about the size/strongness of association
104
two measures for strength of association
1. difference of the conditional proportions between treatment and control group
2. relative risk: ratio of conditional proportions
105
bij categorical, wanneer gebruik je wat?
2x2 rows: je kan z score gebruiken
meer dan 2 rows: chi square test gebruiken!
106
als je de z score gebruikt voor tabel, hoe doe je dit met de proporties berekenen?
^p = aantal successen/totaal n
^p1 = aantal successen ene groep / totaal n
^p2 = aantal sucessen andere groep / totaal n
107
x2 distribution is eigenlijk...
sampling distribution under H0
108
welke waarde vul je hier in bij de chisq.inv(x;df)
probability = 0,95!!!! niet 0.05!!!!
109
hoe bereken je population proportions
deel/row total
110
HOE KOM JE BIJ DE T SCORE VOOR T0,025
t0,025 -> t.inv(0,975)!!!!
