p-vale

Question 1

Key takeaways Fisher, 1926

Answer 1

• Wrote about the arrangement of field experiments
• the concept of randomization as a critical method for controlling bias in field experiments
• discussed the importance of random assignment of treatments to experimental units to ensure validity
• the use of replication and blocking to reduce variability and increase the precision of estimates
• the 0.05 rule came out of this paper, although, slightly misinterpreted and not his intention

Question 2

Key takeaways Peter Hall and Ben Selinger, 1986

Answer 2

• social scientists have been suspicious of the 0.05 rule
• discussed how Fisher had an unclear line of when the 5% principle was appropriate vs. inappropriate
• discussion: (1) scientists are generally far more stringent than their fellow citizens, (2) the legal system is far more flexible than the traditional scientific one

Question 3

Key takeaways Ronald L. Wasserstein and Nicole A. Lazar, 2016

Answer 3

• ASA statement on p-values
• circle of how it is being used because it is being taught AND it is being taught because it is being used
• statistic community has been concerned about issues of reproducibility and replicability
• ASA agreed that the p-value is useful, bit is commonly misused and misinterpreted

Question 4

Key takeaways Ronald L Wasserstein, Allen L. Schirm, Nicole A. Lazar, 2019

Answer 4

• the use of the p-value threshold is useful in some contexts, but led to misinterpretations and a lack of scientific conclusions
• argues we can move beyond this binary approach of significant or not significant
• alternative strategies such as effect sizes, confidence intervals, context
• ATOM (Accept uncertainty, be Thoughtful, Open, and Modest

Question 5

Key takeaways Elliot Inman, 2019

Answer 5

• p < 0.05 can lead to binary results
• advocating for alternatives
• the need to think critically about the broader context of data