Chapter 14 - Replication and Transparency

Question 1

define direct replication

Answer 1

where the researcher repeats the original study as closely as possible to see whether the original effect shows up in the newly collected data
- can help to confirm results
- can get you to find more confounds

Question 2

define conceptual replication

Answer 2

researchers examine the same research question (same conceptual variables) but use different procedures for operationalizing the variables
- wanting to rule out method effect
- can be seen in the same article

Question 3

define replication-plus-extension

Answer 3

where the researcher replicates thier original study but add variables or conditions that test additional question
- can add mediator, moderator, etc.
- commonly seen in articles

Question 4

why might a study not be replicated?

Answer 4

• contextually sensitive effect (context, settings)
• number of replication attempts (may not find the results just by chance)
• problems with the original study (ex. small sample size)

Question 5

define file drawer problem

Answer 5

problem for meta analysis which might overestimate the support for a theory because studies finding null effects are less likely to be published than studies finding significant results

Question 6

define underreporting null effects

Answer 6

researcher misleads about strength of evidence by not reporting conditions that did not support the hypothesis

Question 7

define p-hacking

Answer 7

questionable data analysis techniques which can lead to nonreplicable results

Question 8

define HARKing

Answer 8

questionable research practise in which researchers create an after the fact hypothesis about an unexpected research results, like they predicted it all along

Question 9

define meta-analysis

Answer 9

quantitative summary of a particular effect
- collecting all studies that estimated a given effect then calcauted the average effect size