Chapter 11 Flashcards
(17 cards)
One-group, pretest/posttest design
One group measured on pretest, exposed to treatment, change and measures them on posttest. No comparison group-bad design!
Maturation threat
Change in behaviour that emerges more or less spontaneously over time.
Prevented by comparison group.
History threats
Historical or external factor that systematically affects most members of treatment group at same time as treatment itself. Must affect most ppl in group in same direction (systematically) not just a few ppl (unsystematically).
Prevented by comparison group.
Regression threat
(Regression to mean)
When group average (mean) is unusually extreme at time 1, next time at time 2 it’s less extreme-closer to average performance.
Comparison groups along with inspection of pattern of results-if comparison group and experimental group are equally extreme at pretest, researchers can account for regression effects.
Attrition threat
When pretest and posttest are administered on separate days and some ppl are not available on second day.
Problem for internal validity when attrition is systematic (when only an extreme participant drops out). Prevent by taking out the person’s results in pre and posttest. Internal validity issue if their score is extreme.
Testing threat
Specific kind of order threat, refers to change in participants as result of taking a test (dependent measure) more than once. (Improved score, fatigued, bored-which could lead to worse scores)
Prevention-no pretest or different pre/posttests.
Instrumentation threat
When a measuring instrument changes over time. (Observers become more lenient or strict)
Different tests used pre/posttest but not equivalent.
Prevention-posttest only, pre/posttest equivalent, retrain coders during experiment. Counterbalance version A at pretest and version B at posttest.
Difference between Instrumentation vs testing threats
Measuring instrument changed from Time 1 to Time 2. Testing threat means participants changed from pre-posttest.
Selection-history threat
Outside event or factor affects only those at one level of independent variable.
Selection-attrition threat
Only one of the experimental groups experiences attrition.
Observer bias
When researchers expectations influence their interpretation of the results.
Observer bias threatens two types of Validity;
Internal and construct
(Internal: Alternative explanation exists for results)
(Construct: depression ratings given by the researcher do not represent true levels of depression)
Demand characteristics
When participants guess what the study is about and change their behaviour in the expected direction.
How do you avoid observer bias and demand characteristics?
Double-blind study best.
Masked/blind design (participants know which group they are in but observer doesn’t.
Placebo effect
When ppl receive a treatment and really improve-but only because the recipients believe they are receiving a valid treatment.
Double-blind placebo control study
Neither the ppl treating the patients, nor the patients know whether they have the placebo or real group.
Null Effect;
Between-Groups Difference and how to fix them:
- Weak manipulations
- insensitive measures
- ceiling and floor effect
Prevention-was the dep/indep variable operationalized? Conduct manipulation check.