12 - The Replication Crisis and Open Science Flashcards
What are the consequences of flexibility (having two dV, adding 10 more observations per condition, controlling for a thrid variable, dropping one condition of the three)?
Increased false-positive rate
What is p-hacking?
the practice of collecting or selecting data or statistical analyses until nonsignificant results become significant.
Here relevant decision during data collection and analysis are based on the outcome of data analysis rather than beforehand
Expected distribution of p-values when there is no effect
Expected distribution of p-values when there is an effect
What is HARKing?
When you
Hypothesize After the Results are Known
In which steps is there p-hacking of the hypothetico-deductive model?
What si preregistration
before data collection
What is the open science framework?
Storage of data, analysis code, materials, preregistration file
What is the prior distribution of H0 under bayesion data analysis. (When the data is not given)?
How does the posterior distribution for example look like for H0 after given data?
What is the Bayesian t-test about?
Comparing two means
What is the bayes factor (BF)
difference of density under prior vs. posterior distribution
What does a bayes factor of 1 mean?
no evidence
What does a bayes factor of >100 mean?
Decisive envidence for H1
What does a Bayes factor of <1/100 mean?
Decisive evidence for H0
