Chapter 14 Flashcards
(22 cards)
What is the main purpose of replication in scientific studies?
To verify the reliability of results and confirm that findings are not due to chance
Replication is crucial for establishing the credibility of scientific research.
Define direct replication.
Researchers repeat an original study as closely as possible to see if the effect is the same in newly collected data
Direct replications often involve slight variations in participants or timing.
What is conceptual replication?
Researchers explore the same research question but use different procedures
Conceptual variables remain the same but operationalizations differ.
What does replication-plus-extension involve?
Researchers replicate their original experiment and add variables to test additional questions
This includes adding conditions or new variables.
What is a meta-analysis?
A statistical analysis that yields a quantitative summary of a scientific literature
It averages effects from all published and unpublished studies on the same variables.
List the strengths of meta-analysis.
- Assesses the weight of evidence in scientific literature
- Provides a comprehensive overview of effects
Meta-analysis can summarize findings across multiple studies.
What is a limitation of meta-analysis?
File drawer problem, where negligible or opposite effects may not be included, potentially overestimating true effect size
Researchers should request both published and unpublished data.
What is the replication crisis?
A situation where a significant percentage of studies fail to replicate, questioning the reliability of findings in psychology
Only 39% of 100 selected studies were replicated successfully.
True or False: All studies that fail to replicate should lead to questioning the entire field.
False
Recommended reactions include investigating reasons for failure and improving reproducibility.
What are questionable research practices (QRP)?
Practices that can compromise the integrity of research findings
Examples include underreporting null findings, harking, p-hacking, and using small sample sizes.
Define underreporting null findings.
Researcher reports only the strong effects and not the weak ones
This can mislead readers about the strength of evidence for a theory.
What does harking mean?
Hypothesizing after the results are known
Predictions made after data collection are less convincing than those made beforehand.
What is p-hacking?
Using exploratory practices to achieve a p-value under .05
This can involve selectively reporting data analyses that yield significant results.
Why are small sample sizes problematic?
They can lead to imprecise estimates and reduce replicability
Larger sample sizes generally produce more reliable results.
What is pre-registration in research?
Publicly registering study methods, hypotheses, and analyses before data collection
This practice increases transparency and credibility.
Define theory-testing mode.
When researchers design experiments to investigate support for a theory
Internal validity is prioritized over external validity in this mode.
What is generalization mode?
Generalizing findings from the sample to other populations or contexts
External validity is prioritized in this mode.
Define cultural psychology.
A subdiscipline of psychology focusing on how cultural contexts shape thoughts, feelings, and behaviors
It challenges researchers who work exclusively in theory-testing mode.
What does WEIRD stand for?
Western, Educated, Industrialized, Rich, and Democratic
Research based on WEIRD samples may not be generalizable to other populations.
Define external validity.
How well the results of a study represent people or contexts beyond those in the study
It is influenced by the method of sample selection.
True or False: A large sample is always more representative than a small sample.
False
A representative sample depends on how the sample is selected, not just its size.
What is experimental realism?
The extent to which participants experience authentic emotions, motivations, and behaviors during a study
Laboratory research can achieve high experimental realism.
