Brainscape's Knowledge GenomeTM

Browse over 1 million classes created by top students, professors, publishers, and experts.


See full index

PSYC 306 > Lecture 15: The Experimental Research Strategy ll > Flashcards

Lecture 15: The Experimental Research Strategy ll Flashcards

1
Q

removing the confound

A
  • We can eliminate some confounding variables (ex. Change the testing room, take away the element of surprise)
  • But, we cannot eliminate all confounding variables
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

holding the confound constant

A
  • If we cannot remove the confounded variable, we can try to hold it constant across conditions
  • Ex. caffeine, surprise, music teacher
  • Holding a variable constant eliminates its potential to become a confound
  • By standardizing the environment and procedures (no noise, presence of music teacher), most environmental variables are held constant
  • We can also standardize the confound to a range of values (ex. Only using 30-35 year-old female participants)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

problems with holding the confound constant

A
  • Too strict control can be unreasonable
  • A trade-off between standardizing and external validity
  • Cannot generalize beyond this sample
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

using a placebo control group

A
  • Sometimes, the experimental method itself can become a confounding variable
  • To control for this, we use a placebo-control group
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

matching a confound across conditions

A
  • If we cannot remove or hold the confounded variable constant, we can try to match levels of it across conditions (balanced)
  • But, matching based on fixed values can limit the generalizability (threat to external validity)
  • We can use counterbalancing of variables to reduce effects due to different average values
  • When averages are used, counterbalancing of other factors can be beneficial
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

problems with matching across conditions

A
  • Requires a lot of time and effort
  • Reduces participant sample to choose from
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

when is matching across conditions recommended?

A

for specific sets of variables that pose serious threats to internal validity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

randomizing participants assigned to conditions

A
  • Randomly assign participants to treatment conditions so that the extraneous variables related to participants will balance out across the conditions
  • The aim is to disrupt any systematic relationship between the extraneous and independent variables (to prevent the EV from becoming a CV)
  • Powerful method for controlling many environmental and participant variables simultaneously rather than individually
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

randomizing participants example study

A
  • Participants were recruited for an experiment on one of 3 testing days
  • Each participant was assigned randomly to “Intervention” or “Control” conditions
  • Assign each participant randomly as they appear on testing day
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

how does randomly assigning participants to conditions distribute extraneous variables?

A

using unpredictable and unbiased procedures (ex. coin toss)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

the downside of randomly assigning participants to conditions

A
  • Does not guarantee control
  • It’s still possible that all people with similar backgrounds (potential CVs) are assigned to one condition
  • But, with large enough numbers, randomizing guarantees a balanced result (Groups of >=20 participants per condition)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

two aspects of manipulation checks

A
  1. check the manipulation
  2. include an exit questionnaire
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

checking the manipulation

A

take measures of the IV to make sure your manipulation did what you wanted to do (e.g., sad vs. happy mood)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

exit questionnaire

A

tests whether the participants were aware of the manipulation(s) and purpose of the experiment

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

when are manipulation checks especially importnat?

A
  • participant manipulations
  • subtle manipulations
  • placebo controls
  • simulations
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

participant manipulations

A
  • Difficult to know if worked (especially compared to environmental manipulations)
  • Include a measure of IV (e.g., mood, frustration, stress) to assess if worked
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

subtle manipulations

A
  • Difficult to know if participants noticed
  • Exit questionnaire
  • Ex. “Did you notice the expression on the experimenter’s face when she gave you the instructions?”
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

placebo controls

A
  • Did participants believe the placebo was real?
  • Exit questionnaire
  • Ex. “What treatment did you receive? Did you feel it was effective? Were you aware you were being deceived?”
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

simulations

A
  • Difficult to know if participants perceive the environment as real
  • Exit questionnaire
  • Ex. “What did you think when the other participants answered incorrectly? To what extent did you think about the fact that you were in an experiment?”
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

possible reasons that an experiment didn’t work

A
  • IV is not sensitive enough
  • DV is not sensitive enough
  • IV has floor or ceiling effects
  • DV has floor or ceiling effects
  • Measurement error
  • Insufficient power
  • Hypothesis is wrong
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

example of an IV is not sensitive enough

A

IV= 2 foods to test preferences: chocolate or beets

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

possible solutions to an IV that is not sensitive enough

A

include more foods

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

example of a DV that is not sensitive enough

A

2 levels of preference to rate: yes or no

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

possible solution to a DV that is not sensitive enough

A

use a rating scale (7-point)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

example of an IV with floor or ceiling effects

A

chocolate IV is at ceiling; beets IV is at floor

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

possible solution to an IV with floor or ceiling effects

A

include test items not as preferred/avoided

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

example of a DV with floor or ceiling effects

A

“yes” response is at the ceiling and “no” response is at the floor

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

possible solution to a DV with floor or ceiling effects

A

include responses in the middle range

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

example of measurement error

A

subject variables like hunger or a noisy test environment

30
Q

possible solutions to measurement error

A

control those variables

31
Q

example of insufficient power

A

not enough participants to detect a true effect of the IV

32
Q

possible solution to insufficient power

A

increase sample size

33
Q

example of a hypothesis that is wrong

A

people do not prefer specific foods

34
Q

possible solutions to a wrong hypothesis

A

compare it with previous studies

35
Q

threats to internal validity

A
  1. history
  2. maturation
  3. statistical regression
  4. selection
  5. experimental attrition
  6. testing
  7. instrumentation
  8. design contamination
36
Q

history

A

did some other current event affect the change in the dependent variable? Did all groups experience the same current events?

37
Q

example of a history threat

A

A prominent hip-hop star was arrested on drug charges; fans are affected differently than non-fans in how they complete a survey on interest in media arts

38
Q

maturation threat

A

were changes in the dependent variable due to normal developmental processes?

39
Q

example of a maturation threat

A

Children age and change more quickly than adults

40
Q

statistical regression threat

A

did subjects come from low or high-performing groups that will naturally generate scores more toward the mean?

41
Q

example of a statistical regression threat

A

Two schools compared pre-, and post-test reading scores after the 4-week reading program; Differences within each school may arise because the low scores (more in school 1) cannot go lower

42
Q

selection threat

A

were the participants self-selected or assigned randomly?

43
Q

example of a selection threat

A

adolescents who choose to see a therapist may not be representative of the population

44
Q

experimental attrition threat

A

Did some participants drop out in unequal numbers across conditions?

45
Q

example of an experimental attrition threat

A

students who most dislike college drop out and are not included in a survey of whether study centers were better in high schools or universities.

46
Q

testing threat

A

Did the previous testing affect the behaviour at later testing?

47
Q

example of a testing threat

A

administering different vaccines to the same participants over time reduces their needle anxiety; the last vaccine may be most effective due to testing effects

48
Q

instrumentation threat

A

Did the measurement method change during the research?

49
Q

example of an instrumentation threat

A

the interviewer gets tired and does not ask as many questions of the last participants in the study with the 2-hour interview.

50
Q

design contamination threat

A

did participants find out something about the experimental conditions?

51
Q

example of a design contamination threat

A

People in a 2-person study about decision-making notice there is less opportunity to win in one condition than another; they start to compete more, believing that they are being judged

52
Q

threats to external validity

A
  1. unique program features
  2. effects of selection
  3. effects of environment/setting
  4. effects of history
53
Q

unique program features

A

There may have been an unusually motivated set of experimenters in some conditions. Can this experiment be replicated in another lab?

54
Q

effects of selection

A

Was the recruitment and assignment of participants to conditions successful? Can this study be replicated with different participants?

55
Q

effects of environment/setting

A

Can these results be replicated in other labs or other environments?

56
Q

effects of history

A

Can these results be replicated in different periods?

57
Q

lab simulation

A

Trying to bring the real world into the lab by creating conditions within an experiment that closely duplicate the natural environment

58
Q

effect of lab simulation

A

increases external validity

59
Q

mundane realism

A

how close the lab environment is to the real world

60
Q

experimental realism

A

bringing only the psychological aspects into the lab (participants immersed in simulation may behave normally, not thinking or remembering they are in an experiment)

61
Q

how did original lab simulations work?

A
  • Examination of published simulations for psychological issues (pre-virtual reality)
  • Strong preference for hypothetical scenarios as independent variables (manipulations)
  • Strong preference for qualitative self-reports as dependent variables
62
Q

current day lab simulations

A
  • Realistic immersive stimuli (IV)
  • Quantitative response measures (DV)
63
Q

VR and emotional responses

A
  • High virtual reality (VR) environments influence viewer’s emotional responses
  • More positive effects when immersed in nature
  • Similar to responses observed in actual nature
64
Q

field studies

A
  • Trying to bring the experimental strategy into the real world to increase external validity
  • Can examine behaviours that would be difficult to simulate in the lab
65
Q

examples of field studies

A
  • Kitty Genovese was attacked in a park in 2014. 38 neighbours witnessed the attack, but no one intervened or called the police. Bystander effects may be different in a public area (bus, metro) than in a lab
  • Spatial cognition in homing pigeons; taught a rooftop loft location and released birds 1-18 km away
66
Q

strength of experimental studies

A

both simulations and field studies allow researchers to test behaviour in a more realistic environment than laboratories

67
Q

weaknesses of experimental studies

A
  • Field studies are difficult venues for controlling all extraneous variables
  • Simulations are dependent on whether the participants believe the simulation is real
68
Q

perils for experimental design

A
  1. Although experimental research requires theories for framing hypotheses for testing, much current experimental research is atheoretical. Without theories, the hypotheses tend to be ad hoc (after the finding) and possibly illogical or meaningless.
  2. Many measurement instruments (questionnaires, rating scales, equipment) used in experimental research are not tested for their reliability and validity and can be incomparable across studies. Consequently, results generated using those instruments are also incomparable.
  3. Experimental research sometimes uses inappropriate research designs, such as irrelevant dependent variables, no tests for interactions, no experimental controls, and non-equivalent stimuli across conditions. Findings from such studies tend to lack internal validity.
  4. The conditions used in experimental research may be incomparable or inconsistent across studies. The use of inappropriate tasks for participants introduces threats to external validity (would other participants have responded differently), making comparison of findings across studies difficult.
69
Q

ways to avoid the perils of experimental design

A
  • Use pre-validated stimulus materials and tasks if available
  • Conduct treatment manipulation checks (by debriefing subjects after performing the assigned task)
  • Conduct pilot tests with a small sample to ensure the roles of the IV and DV
  • Use tasks that are simpler and familiar for the participants, instead of tasks that are complex or unfamiliar
70
Q

2 types of realism

A

mundane and experimental realism

PSYC 306 (17 decks)

Brainscape helps you reach your goals faster, through stronger study habits.
© 2024 Bold Learning Solutions. Terms and Conditions