Exam 2 Flashcards

(78 cards)

1
Q

What is a Quasi-Experimental Appraoch

A

must have an IV and DV
cannot randomly assign participants to levels of the IV
Loss of control over the experiment

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Types of Quasi-Experiments

A
  1. Independent groups (non-equivalent control-groups design)
  2. Repeated measures (interrupted time-series design)
  3. Combined: non-equivalent control-groups interrupted time-series design
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What are Independent groups quasi experiments

A

non-equivalent control group design

have a comparison group but no random assignment to condition

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What are repeated-measures quasi experiments

A

interrupted time-series design

Participants/groups are measured multiple times before, during, and after an “interruption” (the event of interest)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

what are non-equivalent control-groups interrupted time-series design

A

The interrupted time-series design with nonequivalent groups involves taking a set of measurements at intervals over a period of time both before and after an intervention of interest in two or more nonequivalent groups.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

How are quasi-experimental designs in terms of statistical validity

A

pretty good, same as experiments

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

How are quasi-experimental designs in terms of construct validity

A

can be really good, same as or even better than experiments

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

How are quasi-experimental designs in terms of external validity

A

can be really good, same as or even better than experiments

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

How are quasi-experimental designs in terms of internal validity

A

not good!

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

how to controls for selection effects in quasi-experiments

A

“wait list control”

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Likert-style items

A

Rate agreement of a statmetn on a scale of strongly disagree to strong agree

I am creative

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Forced choice items

A

I am creative
I am uncreative

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Semantic differential items

A

uses opposite adjectives
rate your creativity from
1 = uncreative
7 = creative

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Threats to constructs validity of surveys

A

Problems with survey itself:
* Leading questions
* Limited range of response options
* Double-barreled questions
* Negatively-worded (confusingly-worded!) questions

Problems with how participants may respond:
* Response sets
* Fence-sitting (not an issue for every construct)
* Acquiescence bias (“yea-saying”)
* Social desirability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Doubled-barreled questions

A

Touches on more than 1 issue, but you can only give 1 answer

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Likert Items are for

A

continuous quantitive variables (interval)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Forced-choice items

A

Categorical / nominal variables

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

An ANOVA or a regression is typically prefered to a chi square because

A

if we can analyze more variance (1 to 7 vs. yes/no), we have a better chance of finding an effect

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

___ data have less power and precision than ____ data

A

continuous

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

If it’s an important construct…

A

include more than one item

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

what is an important consideration in survey construction

A

pay attention to reliability and validity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Bivariate Correlation

A

How 2 variables (usually scale/continuous but not necessarily) are linearly related; on a standardized scale

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

coefficient r in a bivariate correlation

A

quantifies the relationship
-1 to +1
Sign indicates direction
Absolute value indicates strength of association

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

Correlations are both descriptive and inferential

A

You can have weak but
significant correlations (mostly a
test of if your N is large enough)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Internal Validity for correlational design
correlational studies have limitations that make it hard to make a causal claim
26
Construct and statistical validity for correlational designs
both are pretty similar between correlational designs and experimental designs
27
What three things can influence a correlation
outlier, restriction of range, and nonlinearity
28
What is face validity?
Does it look like a good measure? Ask experts!
29
Criterion Validity
Measure predicts some real-world outcome (like an important test/clinical diagnosis etc.)
29
Convergent Validity
* Measure is more associated with similar measures * Correlates with things it ought to correlate with
30
Discriminant (divergent) validity
* Measure is not associated with dissimilar measures (not negatively associated with; r = 0) * Doesn’t correlate with things it ought not correlate with
31
Patterns and Parsimony
When a variety of correlational findings establish a single cause-effect relationship then that is a case of pattern and parsimony
32
Longitudinal Designs
Measure people over multiple time points
33
Cross sectional correlations
2 variables measured at same time are correlated
34
Autocorrelations
the correlation of each variable with itself over time; might be a problem
35
Cross-lagged correlations
earlier measure of one variable correlates with a later measure of a different variable — how people change over time; can help establish ??? .
36
What can help with the directionality problem
Longitudinal studies
37
What is the third-variable problem
A type of confounding in which a third variable leads to a mistaken causal relationship between two others.
38
Multivariate Designs
* More than 1 “IV” * Often we begin with a simple bivariate exploration: variable A & B * Then we often use multivariate analyses to dig deeper * To look at the impact of multiple predictors on a single outcome variable * Especially when trying to establish causality, but can’t do an experiment
39
Multiple regression is just an expansion of
correlation
40
Multiple Regression is a
correlation between several predictor variables (IVs) and a single outcome variable (DV)
41
Each regression coefficient represents the relationship between
IV-1 and DV, controlling for the other variables
42
Mediation Grades, Self-Esteem, and Happiness example
Grades predict Self-Esteem, and Self-esteem predicts Happiness. Self-esteem is the “mechanism”. Grades themselves do not predict happiness.
43
Moderation Grades, Self-Esteem, and Happiness example
Grades predict Happiness but only for certain levels/groups/ aspects of Self-esteem
44
Mediators and Third Variables Similarities
* Both involve multivariate research designs * Both can be detected using multiple regression
45
Mediators vs Third Variables Differences
* Third variables are external to the correlation (problematic) * Mediators are internal to the causal variable (not problematic; explain a relationship)
46
Four Types of Reliability
Test-retest Inter-rater Internal Consistency Parallel forms
47
Test-retest:
Relevant for most measurements
48
Inter rater:
Relevant only if 2 raters produce the measurement
49
Internal Consistency
Relevant only if measurement includes survey/ questions; do not get it confused with “internal validity”
50
Mediation
A mediator variable transmits the effect from an independent variable to a dependent variable
51
Moderation
A term interchangeable with “interaction.” Eg. IV predicts DV only for certain levels.
52
Same methods same data
reproducibility
53
Same methods different data
Generalizability
54
different methods and same data
sensitivity
55
different methods and different data
full generalizability / conceptual replicability / other reason
56
why would you do reproducibility
to ensure that there wasn't a type one error
57
When alpha is set at .05, this means that approximately __ in ___ significant effects is a false finding (if there is truly no effect)
1 in 20
58
What is the point of conceptual replication
generalizability, to test the truth of the underlying hypothesis, and discover boundary conditions
59
What did diederik Stapel do?
Had influential work and fabricated data for over 50 peer reviewed journal articles
60
What research did not replicate well
Social priming research
61
What percent of the studies replicated
35%
62
P-hacking
Collecting data or analyzing your data in different ways until non-significant results become significant.
63
HARKing
Hypothesizing after results are known You analyze data and find a significant result (might be unexpected), and post-hoc come up with a hypothesis. Importantly, you then report the findings as though this has been the case all along
64
Cherry Picking
Select/report only data/findings that support your hypothesis. If your data/findings do not support it, you hide it away in the "file drawer"
65
Fishing/data dredging
No hypothesis in mind just look through data until you find something significant
66
Some methods of catching/correcting errors in science
solid training in methodology and statistics peer review open discourse retractions replications fraud detection open framework adversarial collaborations
67
Institutional Review Board
Committee that interprets ethical principles and ensures ethical procedure for a human research
68
Tuskegee Study
Did not give informed consent or tell people they had syphilis or give them proper treatment
69
Besides the IRB who else decides what is ethical and how
the HHS (Department of health and human services) and OHRP (office for human research protections)
70
Beneficence
Maximize benefits and minimize risks
71
Respect for persons
an autonomy principle involving informed consent
72
Justice
Ensure that equity is not violated when selecting participants Decisions to include or exclude must be made on scientific grounds
73
3 Belmont Principles
Beneficence, Respect for Persons, and Justice
74
5 APA Ethics Principles
Beneficence and Nonmaleficence Fidelity and responsibility Integrity Justice Respect for People's Rights and Dignity
75
Fidelity and Responsibility
Be responsible and professional in interactions with people
76
Integrity
Don’t lie, cheat, steal, commit fraud, etc
77
What are the problems with Facebooks study?
No Informed Consent Did not know they were in a study No debriefing Violates beneficence and nonmaleficence (benefit does not outweigh the risk)