Week 3: Validity part 1 Flashcards
1
Q
validity
A
approximation to truth/falsity of propositions
2
Q
4 types
A
- statistical conclusion
- internal
- construct
- external
3
Q
statistical conclusion
A
covariation of variables: changes in A detectable changes in B (do we see an effect on B)
4
Q
threats to statistical conclusion (list) (7)
A
- low statistical power (type 2 error)
- violated assumptions on tests
- fishing
- measurement reliability
- random irrelevancies in experimental setting
- random heterogeneity of respondents
5
Q
type 2 error
A
- sample size/n is small - alpha is low
- two-tail hypothesis
- manipulation wasn’t strong enough
- w/i group variance is large
6
Q
violated assumptions on test
A
- test if assumptions are true before coming to conclusions about covariance
7
Q
fishing/type 1 error
A
- multiple comparisons increase chance
- cure: stats
8
Q
measurement reliability
A
- if unreliable -> cannot be counted
- cure: have multiple items in test
9
Q
treatment implementation reliability
A
- lack of standardization
- can inflate variance
- cure: consistency/standardized
10
Q
random irrelevancies in experimental setting
A
- some features of setting affect DV scores -> inflate error variance
- monitor experiment closely
11
Q
random heterogeneity of respondents
A
- people differ in qualities/sensitivity to IV/DV/measurements
- homogenous sample
12
Q
internal validity
A
- causal relationship (do we know A caused B)
- time sequence
- not easily established
- threats depending on design
13
Q
pre-post test design
A
- pre-test -> manipulation -> post tests
- comparing scores before/after manipulation
14
Q
threats (pre-post test design w/no random assignment)
A
- history
- maturation
- testing
- instrumentation
- statistical regression
15
Q
history
A
- effect bc event took place between pretest and post test
- treatment: controlled environment, DV unaffected by other things