Exam 1 Flashcards
(111 cards)
1
Q
Empiricism
A
The practice of basing ideas and theories on testing and experience
2
Q
Characteristics of scientists
A
Empiricists, they test theories, they tackle applied and basic problems, they make their research public through the publication process, they talk to the world in popular media
3
Q
Theories
A
A systematic body of ideas about a particular topic/phenomenon
describes a relationship among variables
organizes/summarizes knowledge or findings
describes, explains, or predicts behavior
supported by data
FALSIFIABLE
4
Q
Confounds
A
Plausible alternatives for the fidning – something that varies along with our IV
5
Q
What is the problem with using experience to come to conclusions
A
No comparison group, has tons of confounds, not probabilistic
6
Q
What is the problem with using intuitions as science
A
Intuitions are inconsistent, describe the past, and may lead us astray
7
Q
Availability Bias
A
Things that come to mind easily are more available to memory and can guide
and/or bias our thinking. Especially true of memories that are recent or vivid
8
Q
Present/Present Bias
A
-Examples that are easier to call to mind are
more “available” and can guide/bias our
thinking
- Very similar to availability, but more specifically
deals with the fact that we often fail to look at
absences. Failure to consider appropriate
comparison groups!
9
Q
Confirmation Bias
A
The tendency of people to favor information that confirms or strengthens their beliefs or values and is difficult to dislodge once affirmed
10
Q
What is the order of a Scientific Paper
A
Introduction, method, results, discussion
11
Q
Steps of Reading a paper
A
- Skim
- Re-Read
- Interpret
- Summarize
12
Q
Measured Variables
A
Observed and recorded
13
Q
Manipulated Variables
A
Controlled for
14
Q
Conceptual Variable (construct)
A
abstract, general, theoretical
15
Q
Operational Definitions
A
concrete, a specific way to measure something
16
Q
What are some physiological measures in psychology
A
fMRI BOLD Signal
17
Q
What is better physiological or observational measures?
A
It depends!
18
Q
Nominal Variables
A
Categorical
names or categories
19
Q
Ordinal
A
Rankings
Quantitative
20
Q
Interval
A
Equally spaced numbers
quantitative
scale
21
Q
Ratio
A
Meaningful Zero
Quantitative
Scale
22
Q
Frequency Claims
A
One variable, measured
23
Q
Association Claims
A
2 Variables are linked, both are measured
24
Q
Causal Claims
A
1 variable causes change in the other
One must be manipulated
25
Covariance
as A changes, B also changes
(same direction or
different direction)
26
In order to make a causal claim, you must have
covariance, temporal precedence, and internal validity
27
Temporal Precedence
Experimental manipulation -> change in outcome
behavior occurs before effect
28
Internal Validity
The study’s method ensures that there are no plausible
alternative explanations for the change in B; A is the only thing that is changed
29
What are the 4 types of validity
Construct, Statistical, Internal, and External
30
Construct Validity
- Quality of the measures and manipulations
- Did you measure what you said you were going
to measure?
- How good is the operationalization
- How reliable are the measures (more later)
31
External Validity
- How might we want to generalize?
- To other participants
- To other settings (lab/field, cultures/countries, work/home/school)
- To other operationalizations of the same construct
32
Statistical Validity
- Appropriate and reasonable statistical
conclusions
- How well do the numbers support the claim?
- Do you believe the numbers or think the stats
are lying to you?
- Do they make the right decision based on the p-value?
-What is the effect size?
- Is it well-powered?
33
Internal Validity
- Was the study free of confounds/alternative explanations?
- Experiment with random assignment to condition?
- Strong control over variables?
- No differences between conditions other than the IV?
34
Which Validity is typically prioritized
Internal
35
A Valid claim is ___, ___, and ____
A valid claim is reasonable, accurate, and justified
* Reliability is necessary but not sufficient for validity
36
Ceiling Effect
all observed scores are on
the high end
37
Floor Effect
all observed scores are on
the low end
38
Confound
A design confound is when a second variable varies systematically along
with the IV and provides an alternative explanation for the results; experimenter’s mistake
39
Internal validity is only threatened if there is ___ variability with the IV
systematic
40
Systematic variability
trends together
41
Unsystematic variability
random or haphazard, affects both groups; not a confound!
42
Selection Effects
when the kinds of participants in 1 group are systematically different than another group
43
You can avoid selection effects with
Random assignment
44
Posttest design
Just test after one trial
45
Pretest/posttest design
Test before and after
46
Within Groups designs
All participants are exposed to all levels of the independent variables
repeated measures designs
concurrent measures designs (not popular)
47
Repeated Measures
Participants respond to a dependent variable twice (at
least), after exposure to each independent variable
48
Pros of Within Groups design
* All levels of the IV revealed to participants
* Participants serve as their own comparison
* Fewer participants needed for a study
* No concern of selection effects
* More statistical power (eliminating 1 source
of noise/unsystematic variance)
49
Threats to internal validity with repeated measures
order effects, carryover effects, practice effects, fatigue effects
50
Order Effects
occurs when participants' responses in the various conditions are affected by the order of conditions to which they were exposed
51
Carryover effects:
contamination carrying over from one condition to the
next. You drink caffeine and then take a test. Then you drink decaf coffee and take a test. But caffeine is still in your system by the second test
52
Practice Effects
participants get better at a task over time
53
Fatigue Effects
participants get worse at a task over time
54
Full counterbalancing
all possible condition orders
55
partial counterbalancing
present only some condition orders
56
The Really Bad Experiment
classic pretest/posttest design but only on a single group
no comparison group
57
Ambiguous temporal precedence
when it is unclear if IV causses the DV or the other
58
History Effects
History refers to any event that
occurs between the beginning of
treatment and the measurement of
outcome that might have produced
the observed effect
59
Maturation Effects
Maturation is a change in behavior
that emerges spontaneously over
time. Changes in the organism that
occur regardless of treatment might
masquerade as a treatment effect
60
Attrition Effects
Attrition/Mortality refers to who is
dropping out of your study (or
dying)
61
Regression Effects
Regression to the mean is when
extreme scores become less
extreme over time
62
Testing Effects
Testing effects refer to a change in
participants as a result of
experiencing the DV more than
once
63
Instrumentation Effects
Instrumentation effects refer to a
change because the measurement
changes over time, perhaps
becoming more/less reliable
64
Goodhart's law
When a measure becomes a target it ceases to be a good measure
65
Demand Characterisitics:
participants guess what it's supposed to be about and then change their behavior on expected direction
66
Why might manipulations be weak
operationalization is super hard
67
Measurement Error
use reliable, precise measurements
establish construct validiity of measures
use established measures
measure more instances
68
Statistical Power
the ability to detect an effect if one is there
finding a statistically significant result if the IV really has an effect
studies that are well-powered are able to detect true differences
69
What is the IQ example for confirmation bias
people who scored low on IQ tests spent longer reading articles that criticized IQ test and people who scored high spent longer reading articles that supported the tests
70
How many levels do variables need to have
two or more
71
What is a constant
something that could potentially vary but that has only one level in the study in question
72
Claim Definiton
argument someone is trying to make
73
What are the three types of claims
Frequency, Association, Causal
74
Processing Fluency Account
when information is repeated, ti is processed more fluently and is consequently perceived to be more truthful
75
What amount of repetition shows the largest increase in truth perception
1 --> 2
76
Concurrent-measures
Participants are exposed to all the levels of an independent variable at roughly the same time, and a single attitudinal or behavioral preference is the dependent variable.
77
What are the disadvantages of within group design
Potential order effects (typically resolved with counterbalancing)
May not be possible or practical
When ppl see all levels, they change the way they would normally act
78
Effect Size
D of .2 is small
D of .5 is moderate
D of .8 is large
79
When a study has a relatively small sample and more variability in the data, the CI will be relatively ____
wide (less precise)
80
Two ways to avoid confounds
Matching Groups
Inclusion/exclusion criteria
81
pros of post test
No practice effect
Less time and money
“Blind”
Less attrition/mortality
Temporal precedence
82
Cons of post test
Cant get at the change
You need a much larger sample size
83
Pros of pretest-posttest
Baseline
Each person is their own control
Can have smaller sample size
84
cons of pretest post test
Time
Practice effects
Hard to recruit and attrition
85
Factorial Design
when there are two or more independent variables
86
Participant variable
a variable whose levels are selected/measured not manipulated like age, gender, and ethnicity
87
Interaction Effect
whether the effect of the original independent variable (cell phone use) depends on the level of another independent variable (driver age)
88
testing for moderators
The process of using a factorial design to test limits
89
Main Effect
the overall effect of one independent variable on the dependent variable, averaging over the levels of the other independent variable
90
In a factorial design with two independent variables, how many main effects are there
two main effects
91
Marginal Means
the arithmetic means for each level of an independent variable, averaging over levels of the other independent variable.
92
How do you compute an interaction
you see if there is a difference between differences, and if you are looking on a graph you can tell an interaction if the lines are not parallel
93
What is more important: Interactions or Main Effects
Interactions
94
When a factorial design has three independent variables, how many main effects and interactions are there
three main effects (one for each independent variable), plus three separate two-way interactions and a three-way interaction
95
Three way interaction
if it is significant, means that the two-way interaction between two of the independent variables depends on the level of the third independent variable
96
When would you find a three-way interaction?
whenever there is a two-way interaction for one level of a third independent variable but not for the other (or different two way interactions)
97
meta-analysis
Meta-analysis is the statistical combination of the results of multiple studies addressing a similar research question. An important part of this method involves computing an effect size across all of the studies, this involves extracting effect sizes and variance measures from various studies.
98
Confederate
A person playing a specific role for the sake of the study
99
100
Obscuring factors that can be detected with a manipulation check
floor effects
ceiling effects
weak manipulations
101
Interactions are
symmetric
102
Interactions test
whether the effect of one IV depends on the level of the other IV
103
reliable, precise scales can help with
measurement error
104
experimental control can help with
situation noise
105
within-groups design can help with
individual differences
106
What are obscuring factors that can be detected with a manipulation check?
ceiling effects, floor effects, weak manipulations
107
can measurement error cause null effects and why
yes because it leads to a lot of within group variability
108
power increases with a ___ sample
larger
109
What type of validity can a factorial design increase
external validity
110
What does a moderator do
Changes the relationship between an independent and dependent variable
111
how many interactions could there be in a 4 x 3 design
one
