Lecture 7 Flashcards

1
Q

____ is the key to controlling the outcomes from experimental research.

A

design

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

6 general issues in experimental design:

A
  • internal validity
  • external validity
  • frame of reference
  • longitudinality
  • frequency
  • nested factors
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Internal validity is …

A

the basic minimum without which any study is not interpretable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Internal validity is the extent to which the results of a study can:

A
  • be attributed to the design of the study

- eliminate any rival hypothesis or events influencing the study

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

To gain internal validity, the researcher attempts to control and/or eliminate possible _____ variables.

A

extraneous

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Internal validity is particularly important in ______ studies as well as other studies that establish _____-_____ or _____ _____.

A
  • experimental
  • causal-effect
  • causal relationships
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

When we think the independent variable produces a change in the dependent variable, what do we have to make sure of?

A
  • must rule out the possibility of other factors producing the observed effect
  • must consider the appropriateness of the methods (participants, experimental design, measurements)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Main threat in internal validity:

A

unmeasured process accounting for the observed results

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Secondary threat in internal validity:

A

responses do not correctly reflect underlying dimensions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

How to minimize threats to internal validity:

A
  • random assignment of participants into treatment and control groups
  • ID confounding factors
  • multiple methods approach provides evidence leading to similar results
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

3 main categories to threats to internal validity:

A
  • single group threats
  • multiple group threats
  • social threats
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Single-group threats:

A

a threat to internal validity that occurs in a study that uses only a single program or treatment group and no comparison or control

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Multiple-group threats:

A

an internal validity threat that occurs in studies that use multiple groups

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Social threats:

A

an internal validity threat that arise because social research is conducted in real-world human contexts where people will react to not only what affects them, but also to what is happening to others around them

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Types of single-group threats:

A
  • history
  • maturation
  • testing
  • instrumentation
  • mortality
  • regression
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

History (single-group threat):

A
  • events occurring during he experiment that are not part of the treatment
  • eg. children watching Sesame Street and math score
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Maturation (single-group threat):

A
  • process within the participants that operate as a result of time passing
  • eg. children mature and gain muscle strength
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Testing (single-group threat):

A

the effects of one test on subsequent administrations of the same test

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Instrumentation (single-group threat):

A

changes in instrument calibration, including lack of agreement within and between observers

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Mortality:

A

loss of participants from comparison group for nonrandom reasons

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Regression:

A

the fact that groups selected based on extreme scores are not as extreme on subsequent testing

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Multiple group threats to validity is ____ ____:

A
  • selection bias

- any factor other than the program that leads to posttest differences between groups

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Multiple-group threats types:

A
  • selection-history
  • selection-maturation
  • selection-testing
  • selection-instrumentation
  • selection-mortality
  • selection-regression
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

Selection-history:

A

A threat to internal validity that results from any other event that occurs between pretest and posttest that the groups experience differently

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

Selection-maturation:

A

A threat to internal validity that arises from any differential rates of normal growth between pretest and posttest for the groups.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

Selection-testing:

A

Selection-testing: A threat to internal validity that occurs when a differential effect of taking the pretest exists between groups on the posttest

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

Selection-instrumentation:

A

A threat to internal validity that results from differential changes in the test used for each group from pretest to posttest

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

Selection-mortality:

A

A threat to internal validity that arises when there is a

differential nonrandom dropout between pretest and posttest

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

Selection-regression:

A

A threat to internal validity that occurs when there are

different rates of regression to the mean in the two groups

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

Social interaction threats occur because…

A
  • the various groups participating in the
    study and the researchers carrying out the study are aware of each other’s existence and role in the study
  • many of these people come in contact with each other
  • try to isolate
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
31
Q

Why is it hard to randomly assign and isolate to get rid of social interaction threats?

A

it introduces external validity (generalizability) concerns

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
32
Q

4 types of social interaction threats:

A
  • diffusion or imitation of treatment
  • compensatory rivalry
  • resentful demoralization
  • compensatory equalization of treatment
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
33
Q

Diffusion or imitation of treatment:

A

Occurs because a

comparison group learns about the program either directly or indirectly from program group participants.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
34
Q

Compensatory rivalry:

A

Occurs when one group knows the program another group is getting and, because of that, develops a competitive attitude with the other group

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
35
Q

Resentful demoralization:

A

Occurs when the comparison group knows what the program group is getting and becomes
discouraged or angry and gives up

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
36
Q

Compensatory equalization of treatment:

A

Occurs when the
control group is given a program or treatment designed to make up for or “compensate” for the treatment the program group gets

37
Q

Many threats to internal validity are controlled by making the participants in the experimental and control groups as _____ as possible.

A

alike

38
Q

4 methods for controlling internal validity threats:

A
  • randomization (random assignment
  • placebo
  • blind setup
  • double-blind set up
39
Q

Randomization (random assignment):

A
  • Controls for history up to the point of the experiment but not during the experiment
  • Controls for maturation because passage of time is equivalent in all groups
40
Q

Placebo:

A

a control group receives a false treatment while the

experimental group receives the real treatment

41
Q

Blind setup:

A

the participant does not know whether he/she is receiving the experimental or control treatment

42
Q

Double-blind setup:

A

neither the participant nor the experimenter knows which treatment the participant is receiving

43
Q

External validity threats arise when…

A

experimenters draw

incorrect inferences from the sample data to other individuals, settings, and past/future situations

44
Q

Why do external validity threats arise?

A
  • characteristics of individuals selected
  • uniqueness of the setting
  • timing of the experiment
45
Q

3 major threats to external validity:

A
  • people
  • places
  • times
46
Q

How to increase external validity:

A
  • Drawing on a representative probability sample and avoiding obtrusive measures
  • Develop a model for the population from which one has a sample selected
  • Replicate the sampling procedure and see how it compares to original sample taken
47
Q

Experimental research involves comparisons of ____ performance with some _____ of performance.

A
  • observed

- expectations

48
Q

2 types of comparisons:

A
  • relative

- absolute

49
Q

Relative comparisons:

A

what would have occurred without the intervention or the difference between 2 of more interventions?

50
Q

Absolute comparisons:

A

what is the degree to which the interventions reaches some particular desired outcomes?

51
Q

_____ comparisons are harder to implement.

A

relative

52
Q

____ comparisons require more advanced planning because..

A
  • absolute

- a consensus or other evidence has to be used to compare

53
Q

Longitudinality:

A

the extent to which measures are repeated and extended across time

54
Q

Challenge with longitudinality:

A

mortality (ie. dropping out) over the course of time

55
Q

One way to overcome mortality is…

A

overlapping panel designs with different cohorts

56
Q

Frequency:

A

the number of repetitions within a time period

57
Q

Higher frequency leads to…

A

higher costs

58
Q

Nested factors:

A

effects which are restricted to a single level of a factor are said to be nested within a factor

59
Q

In nested factors, selection of _____, _____, or _____ are not selected ______ from each other.

A
  • locations
  • individuals
  • organizations
  • independently
60
Q

In nested factors, there may be an interaction effect between …

A

treatment within the embedded groups

61
Q

____ ____ ___ may be the most powerful means of generating new knowledge as their confidence in the ____ ____ _____ relationship.

A
  • true experimental design

- cause and efffect

62
Q

True experimental design is typically conducted in a _____ setting.

A
  • laboratory

- controlled environment

63
Q

True experimental design has at least one _____ group (also termed _____ or ____ group).

A
  • experimental
  • treatment
  • intervention
64
Q

True experimental design also has at least one _____ group.

A

control

65
Q

In true experimental design, membership is typically defined using _____ _____.

A

random assignment

66
Q

Any study that is designed with …. is considered a true experiment.

A
  • random assignment of participants
  • a control group
  • manipulation of the independent variable
67
Q

A true experimental study design allows researchers to ____ data and test their ______ with a minimum _____ or ______ from _____ variables.

A
  • collect
  • hypothesis
  • influence
  • contamination
  • extraneous
68
Q

In true experimental study, ____ validity is high but ____ validity is hard to claim. Why?

A
  • internal
  • external
  • tightly controlled settings will have a harder time generalizing to a larger setting
69
Q

R =

A

random assignmnet

70
Q

O =

A

observation of DV

71
Q

X =

A

treatment by IV

72
Q

A1, B1, A2, B2 =

A

notation for multiple IV, moderator, or control variables in factorial design

73
Q

Quasi-experimental studies are those that are …

A

“sort of “ experimental in design

74
Q

The big distinguishing feature between a true experiment and a quasi-experimental design is that…

A

there is no randomization to groups in a quasi-experimental research design

75
Q

Quasi-experimental studies are low on ____ validity because…

A
  • internal

- groups are not likely to be equivalent at the outset of the study

76
Q

Quasi-experimental studies are often higher on _____ validity than true experiments because…

A
  • external

- people are studied in a natural environment, making generalizability more feasible

77
Q

The basic formula for a quasi-experimental study is:

A
  • people are studied in real-word settings
  • an independent variable is introduced or manipulated
  • there is a dependent variable (the effect) that is measured.
78
Q

Xa, Xb, Xc =

A

levels of the IV

79
Q

C =

A

groups assigned according to a cutoff score

80
Q

Repeated measures design is a specific type of ____ ______ design where there is …

A
  • quasi-experimental

- only an experimental group with multiple levels of the independent variable

81
Q

In repeated measures design, _____ are often ____ _____ control group.

A
  • participants

- their own

82
Q

Strength of repeated measures design is that it is …

A

economical in both time and effort of the researcher since the volunteer participants are involved several times with the study

83
Q

In pre-experimental design, researchers examine …. and provide an _____ during the study.

A
  • one group of individuals

- intervention

84
Q

In pre-experimental design, there is either an _____ of a control group for ______ or a ____ _____ _____ group is identified during the study or after the intervention.

A
  • absence
  • comparison
  • non-equivalent comparison
85
Q

Pre-experimental research design pose challenges to both _____ and _____ validity due to …

A
  • internal
  • external
  • not being able to control for many of the threats
86
Q

Non-experimental research design has:

A
  • no randomization to groups
  • no groups to randomize to
  • no manipulation of the IV
87
Q

Non-experimental research design relies on researchers’ ______ and ______ to arrive at conclusions.

A
  • interpretation

- observations

88
Q

Non-experimental research design is used to report ______ and ______ among variables of interest.

A
  • correlations

- associations

89
Q

Non-experimental research design generally looks at _____ research problems such as…

A
  • descriptive
  • cross section (participants assessed at one point in time)
  • longitudinal (following participants over time)