Lecture 16: Between-Subjects Designs Flashcards

1
Q

between-subjects designs

A
  • A different group of participants is assigned to each condition
  • Each group receives a different experimental treatment (value of the IV) and the groups are compared
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

key element of between-subjects designs

A

separate groups of participants are used for the different conditions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

what differences are compared in a between-subjects design?

A

Participants’ data (on the DV) is compared across groups to look for differences

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

how many groups are there in a between-subjects design?

A

You can have any number of groups; it depends on the number of levels of the IV

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

how many scores on the DV are there per participant in a between-subjects design?

A

Because participants experience only one level of the IV, there is 1 score on the DV per participant

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

synonym for between-subjects design

A

independent-measures experimental design

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

measuring IVs in between- vs. within-subjects designs

A
  • Some independent variables can only be measured in a between-subjects design (ex. age, gender)
  • Other independent variables can be measured in a between-subjects or within-subjects design (ex. teaching method, video condition)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

example between-subjects study

A
  • 15-month-old infants watch an adult persist for 30 s in opening objects in an effort or no effort condition
  • Control condition: the child sees the box but there’s no adult present
  • This was done as a between-groups design with 34 infants/condition
  • Infants who saw the adult persist in the effort condition show more attempts to open their box
  • They used a between-groups design because infants have a limited attention span
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

how do you determine an effect of the IV in a between-subjects design?

A

by comparing the mean scores (DV) for each group

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

systematic variance

A

the difference in the DV between groups

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

non-systematic variance

A

the difference in the DV within groups

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

what type of variance do we want to minimize?

A

Non-systematic variance beacuse it’s an important source of error

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

what sources of variability do we use to calculate our test statistic?

A

systematic & non-systematic variance

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

2 components of between-subjects (systematic) variance

A
  • Treatment effects
  • Effects of chance factors (experimental error)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

If we treated the groups the same way, would you expect to see the same scores on your DV?

A

No, it is impossible to perfectly match groups, therefore there are always some errors and some differences between means

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

experimental error

A

all chance factors not controlled for

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

types of experimental error for between-subjects designs

A

individual differences & variations in the testing environment

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

within-group (non-systematic) variance

A
  • Any differences between subjects who are treated alike
  • Within any given treatment group, all subjects have been treated identically and should have the same value for the DV
  • Any variability can only be a result of chance factors
  • Non-systematic (within-group) variance = experimental error
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

how do we form the F-ratio?

A

We use between-group and within-group variance, to form the condition or treatment index

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

effect of treatment effects on the F-ratio

A

F-ratio is responsive to the absence or presence of treatment effects (i.e. the effect of the IV)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

treatment index formula

A

treatment index= between-groups variance/ within-group variance

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

treatment index modified formula

A

treatment effects + experimental error/ experimental error

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

how do you determine statistical significance in a between-subjects design?

A

you compare the between-group variance to the within-group variance

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

impact of large variances

A
  • Large between-group variance is good
  • Large within-group variance is bad
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

interpreting F-ratios

A
  • Between-group variance > within-group variance = F-ratio is positive and large
  • Between-group variance < within-group variance= F-ratio is near 0 and small
26
Q

standard error bars

A

the measure of the variance in the data within each group

27
Q

what type of variance will yield a non-significant F-ratio?

A

Small between-group variance or large within-group variance

28
Q

comparing more than 2 groups in a between-subjects design

A
  • You can use a single-factor multiple-group design
  • Ex. comparing driving performance under three conditions: cell phone, handsfree phone, no phone
  • Sometimes, using more than 2 groups provides stronger evidence for a real cause-and-effect relationship than a two-group design
29
Q

what differences do researchers want to minimize and maximize

A
  • Researchers try to maximize between-group differences (i.e. make sure you are comparing two distinct things)
  • Researchers try to minimize within-group differences
30
Q

how do experimenters minimize within-group differences?

A
  • Make sure all participants within a group are treated the same
  • Standardize the experimental procedures
  • Minimize individual differences
  • Hold extraneous variable constant or restrict the range
  • Use a large sample size
31
Q

effect of random assignment on variance

A

random assignment does not affect within-group variance

32
Q

two major sources of confounding variables in between-subjects designs

A
  • Individual differences (from assignment bias)
  • Environmental variables
33
Q

individual differences

A

any personal characteristic that differs from one participant to another

34
Q

do we want treatment groups to be similar or different?

A

We want to make sure that the different groups are as similar as possible, except for the IV

35
Q

assignment bias

A

when the process of assigning participants produces groups with different characteristics

36
Q

assignment bias is a threat to ____

A

internal validity

37
Q

environmental variables

A

any characteristics in the environment that may differ

38
Q

impact of environmental variables on the validity of the study

A
  • If these differ between groups, we may have an extraneous variable that becomes a confound
  • We can no longer say that the treatment (IV) caused the outcome
  • It could be an environmental factor
39
Q

To establish equivalent groups of participants, a researcher must:

A
  • Created equally
  • Treated equally
  • Composed of equivalent individuals
40
Q

ways to limit individual differences and environmental variables

A
  • randomization
  • matching
41
Q

randomization

A
  • Participants are randomly assigned to groups to ensure groups are as equal as possible before treatment
  • It is the most powerful technique to control for the effect of pre-existing differences by equalizing them (spreading them evenly)
  • Randomly assigning individuals to different conditions to ensure even distribution of individual differences across conditions
42
Q

randomization vs. random sampling

A
  • Randomization is not the same thing as random sampling
  • Random sampling: random selection of participants from a larger population to participate in the study
  • Randomization: random assignment of participants to experimental or control groups in a particular study
43
Q

free random assignment

A
  • Coin toss to ensure that participants are assigned to groups solely based on chance
  • Each P has an equal chance of being assigned to any one of the treatment conditions
  • Theoretically, it should lead to equality, but there is no guarantee
44
Q

importance of modifying randomization

A
  • It’s improbable that groups will be perfectly matched, but will differ only randomly, which is typically very small
  • Therefore, differences among groups are treatment effects and will neutralize nuisance effects at the same time
  • With small samples, there are no guarantees
  • Therefore, we can modify randomization to have better control over the outcomes
45
Q

matching

A
  • Participants are matched on critical variables
  • This guarantees groups are equivalent on critical variables
46
Q

4 steps of matching

A
  1. Identify the variable(s) to be matched and identify the potential confounding variables associated with this variable
  2. Measure and rank subjects on the variable for which control is desired (this may require a pretest)
  3. Segregate subjects into matched pairs on that variable
  4. Randomly assign pair members to the conditions
47
Q

matching across blocks

A
  • Matching can be extended to units larger than pairs
  • Groups of individuals are matched in blocks
  • Random assignment to groups from each block
48
Q

threats to internal validity in between-subjects design

A
  • attrition
  • communication between groups
  • resentful demoralization
49
Q

attrition

A

Refers to participants leaving the study before completion

50
Q

when is attrition a problem?

A
  • Not a problem if members of all groups leave at the same rate
  • This is a problem if they leave one group at a higher rate than in other groups (differential attrition)
  • The groups are no longer equivalent
  • Is the difference between groups due to treatment effects or differential attrition?
51
Q

communication between groups

A
  • Diffusion may occur
  • Treatment effects spread from one condition to another condition
  • The true effects of treatments may be masked by shared information
  • One group is getting the benefit of information from another group
  • There appears to be no effect
  • Communication between groups can also result in resentful demoralization
52
Q

resentful demoralization

A
  • One group might receive course credit while another group might receive payment
  • Any perceived inequity can influence behaviour
  • In these cases, observed differences between groups have alternate explanations
53
Q

advantages of between-subjects designs

A
  • Simple design: each score is independent from other scores
  • Clean and uncontaminated by other treatment factors like carryover and practice effects
  • Takes less time for each participant
  • Causality can be established
54
Q

why are between-subjects designs popular?

A
  • Because carryover effects are of unknown duration
  • One can estimate the bias introduced by carryover effects
  • Implication: carryover effects create more bias as the number of conditions increases
55
Q

disadvantages of between-subjects designs

A
  • Requires many participants
  • It can be difficult to recruit enough people from special populations
  • Individual differences and environmental differences can exist
  • Generalization (external validity) can be hard if holding subjects constant on extraneous variables reduces their representation in the population
  • Assignment bias, experimenter-expectancy and subject-expectancy biases
56
Q

solutions to assignment bias, experimenter-expectancy, and subject-expectancy biases

A

Assign participants to conditions so that:
1) Participants are blind to (unknowledgeable about) the condition
2) Experimenters are blind to the condition
3) Both are blind (double-blind)
4) Analyst is blind to the condition of the participants

57
Q

when to use a between-subjects design

A

To avoid comparison or carryover effects

58
Q

when not to use a between-subjects design

A

When similar anchoring is desired across conditions

59
Q

anchors

A

the interpretation of the labels at the endpoints of a rating scale

60
Q

important considerations when choosing a between-subjects design

A

does the between-subjects design avoid:
1) Carry-over effects: the influence of one condition on other conditions
2) Participants’ awareness: sensitized to task measures over time
3) Ecological validity: if the participant is not usually exposed to all levels of a variable in nature, then the results are not representative
4) Changes in measurement properties/ tests over time