open science

Question 1

What is statistical power?

Answer 1

-Probability of seeing a true positive

Question 2

What is alpha?

Answer 2

-Highest acceptable risk of a false positive (typically 5%)

Question 3

What is P-hacking?

Answer 3

-Way to cheat or lie in statistics
-Perform analysis in different ways to get p< 0.05

Question 4

What did Munoz and Young (2018) find?

Answer 4

-Analyse the data with N = 1,152 regressions
-Less than 5% had a significant effect

Question 5

What are the 2 problems?

Answer 5

-Significant results are easier to publish, including false positives
-Papers are underpowered, true positive not seen

Question 6

How to solve the crisis?

Answer 6

-Open materials
-Open data
-Preregistered

Question 7

Describe what is meant by open materials

Answer 7

-Share materials e.g. instructions, program snd stimuli
-Makes it easier for replication

Question 8

Describe what is meant by open data?

Answer 8

-Share raw data
-Allows other researchers to perform analysis and see how variables affect the results

Question 9

Describe what is meant by preregistration?

Answer 9

-Plan study in advance e.g. materials and planned analyses
-Prevents p-hacking and harking