Ch. 9 - Research & Program Evaluation Flashcards

1
Q

Internal validity

A
  • refers to whether the DVs were truly influenced by the IVs or whether other factors had an impact
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

External validity

A
  • refers to whether the experimental research results can be generalized to larger populations
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Experiments emphsaize parsimony, which means

A
  • interpreting the results in the simplest ways
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Occam’s Razor suggests

A
  • that experimenters interpret the results in the simplest manner
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Flaws in research are often called

A
  • bubbles (think air bubbles stuck under a sticker)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

An experiment is confounded when…

A
  • undesirable variables are not kept out of the experiment
  • AKA contaminating variable
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Basic research vs. applied research

A

Basic research: conducted to advance our understanding of theory

Applied research AKA action research: conducted to advance our knowledge of how theories, skills, and techniques can be used in terms of practical application

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Causal-comparative design

A
  • a true experiment that lacks randomly assigned groups
  • data can be analyzed with a test of significance (i.e., t-test or ANOVA) just like experiement
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

If you can’t randomly assign subjects into groups…

A
  • considered quasi-experimental
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Hypothesis testing is related to work of

A

RA Fisher

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Null hypothesis

A
  • suggests that there will not be a significant difference between groups
  • the IV does not affect the DV
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Alternative hypothesis

A
  • suggests that there will be a significant difference between groups
  • IV does affect DV
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Percentage vs. percentile

A

Percentage: Raw score

Percentile: descriptive statistic that thells what percentage of cases fell below a certain level

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

p = .05 means…

A
  • differences really do exist
  • will obtain samee results 95/100 times
  • 5% error factor
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Type I error

A
  • When you reject the null when it is true
  • lowering significance levels lowers type I errors
  • AKA alpha error
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Type II error

A
  • When you accept the null when it is false
  • AKA beta error
  • lowering significance raises the risk of type II error
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

If researcher changes significance level from .05 to .001

A
  • type I error decrease, type II error increase
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

t-test

A
  • used to compare two groups with single IV
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

one-way ANOVA

A
  • used when there is more than one level of a single IV
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

two-way ANOVA

A
  • used with 2 IVs
  • more than 1 IV = factorial design
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Correlation coefficient

A
  • indicates degree or magnitude of relationship between two variables
  • degree of linear relationship
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

N = 1

A
  • intensive experimental design
  • case study
  • popular with behaviorists who seek overt behavioral changes
  • AKA idiographic studies or single-subject designs
23
Q

Normal distribution stats

A
  • 68% fall within +- 1 SD
  • 95% fall within +- 2 SD
  • 99.7% fall within +- 3 SD
24
Q

Regardless of the shape the _ will always be the high point when a distribution is displayed graphically

A
  • mode
25
Q

X axis used to
Y axis used to

A
  • plot the IV (horizontal)
  • plot the DV (vertical)
26
Q

Range

A
  • highest - lowerst score or highest - lowest score + 1
  • increases with sample size
27
Q

Z-scores

A
  • same as SDs
  • AKA standard scores
28
Q

Platykurtic distribution

A
  • looks like the upper half of a hot dog lying on its side
  • flat and spread out
29
Q

Kurtosis =

A
  • refers to the peakedness of a frequency distribution
30
Q

Leptokurtic =

A
  • tall and thin distribution
31
Q

Stanine scores

A
  • divide the distribution into nine equal intervals with stanine 1 as the lowerest ninth and 9 as the highest ninth
32
Q

Nominal
Ordinal
Interval
Ratio

A
  • Qualitative; distinguish groups; no true 0; does not indicate order
  • Rank order; relative distance not always equal; relative placement or standing; does not delineate absolute differences
  • Interval: numbers scaled at equal distances; no absolute 0; can add and subtract, but can’t multiply or divide; IQ tests are interval
  • Ratio: Interval scale with true 0; addition, subtraction, multiplication, division possible; most psychological attributes cannot be measured on ratio scale
33
Q

Nocebo
Placebo

A
  • has a negative effect
  • i.e., when a doctor comments one only has 6 weeks to live
  • placebo has possitive effect
34
Q

Hawthorne effect

A
  • if subjects know they are a part of an experiment, their performance sometimes improves
  • reacting to the presence of the investigation
  • AKA observer effect
35
Q

Rosenthal effect

A
  • AKA experimenter expectancy effect
  • the experimenter’s beliefs about the individual may cause the individual to be treated in a special way so that the individual begins to fulfill the experimenter’s expectations
36
Q

Halo effect

A
  • when a trait which is not being evaluated influences a researcher’s rating on another trait (i.e., attractiveness and counseling)
37
Q

Statistical regression

A
  • predicts that very high and very low scores will move toward the mean if a test is administered again
38
Q

Ipsative implies

A
  • within-person analysis (i.e., was you jog faster today than yesterday) rather than a normative analysis between individuals
39
Q

Demand characteristics

A
  • can confound an experiment
  • relates to any bit of knowledge - correct or incorrect - that the subject in an experiment is aware of that can influence their behavior
40
Q

Post-hoc tests

A
  • Duncan’s multiple-range
  • Tuey’s
  • Scheffe
  • further discriminates between the ANOVA groups
41
Q

Pygmalion effect

A
  • Rosenthal effect and experiment becomes a self-fulfilling prophecy
42
Q

Ahistoric therapy

A
  • any therapy that focuses on the here and now
43
Q

Statified sampling

A
  • When a special characteristic needs to be represented in the sample, such as race, gender, etc.
44
Q

Snowball sampling

A
  • when subjects invite others to the study
45
Q

Sampling error

A
  • small samples do not mimic the population
46
Q

Systematic sampling

A
  • picking a number between 1 and 10 and then picking every nth person
47
Q

Operational definition

A
  • outlines a procedure
  • operationally define procedures so one can replicate the procedure
48
Q

Axiom

A
  • universally accepted idea needing no additional proof
49
Q

Non-parametric measures

A
  • Mann-Whitney U test
  • Wilcoxon signed-rank test for matched pairs
  • Soloman and the Kruskal-Wallis H test
50
Q

Matched design

A
  • subjects are matched in regard to any variable that could be correlated with the DV, which is really the post-experimental performance
  • unmatched groups are known as independent groups
51
Q

Inductive logic or reasoning
Deductive logic or reasoning

A
  • the research goes from specific to generalization
  • research goes from general to specific
52
Q

Standard error of measurement (SEM)

A
  • tells what would most likely occur if the same individual took the same test again
53
Q
A