Questionable Research Practices

Question 1

What year Was the world’s psychology lab established in, and by who?

Answer 1

1879
Wilhelm Wundt

Question 2

The aim of the open science collaboration (2015) was the ____ the ____ of ____ science

Answer 2

Estimate, reproducibility, psychological

Question 3

The Open Science Collaboration attempted to replicate findings published in high profile journals.
They found replicated ____ sizes were ____ the size of the ones than ____ reported

Answer 3

effect, half, originally

Question 4

97% of original p-values were statistically significant. How many replicated p-values were statistically significant?

Answer 4

Only 36% of replicated p-values were statistically significant

Question 5

Replication is the process of ____ the same ____ using ____ ____

Answer 5

repeating (re-running), study, identical methodology

Question 6

What is meant by publication bias?

Answer 6

The bias in the publication system where statistically significant results are favoured for publication over non-significant findings.

Question 7

Papers reporting significant p-values are how many times more likely to get published compared to papers reporting non-significant findings?

Answer 7

9 times more likely

Question 8

Questionable research practices are a range of practices that ____ (____ or ____) the results motivated by the ____ to find ____ for hypotheses and make research more ____.

Answer 8

distort (intentionally or unintentionally)
desire
support
publishable

Question 9

What is Hanlon’s Razor:
“Never attribute to ____ that which is adequately explained by ____ or ____.”

Answer 9

malice
ignorance or incompetence.

Question 10

P-hacking is taking specific ____ steps in order to achieve statistical ____ rather than (pre-planned) steps that are more ____ to answer the research question

Answer 10

analytic
significance
appropriate

Question 11

HARKing refers to ____ after the ____ are known
Often involves collecting data without a clear ____, deciding on a hypothesis based on what’s ____, and then presenting the hypothesis as if it was decided on ____ running any analyses.

Answer 11

Hypothesizing, Results
hypothesis, significant, before

Question 12

What is selective reporting?

Answer 12

Collecting a lot of variables and only reporting statistically significant relationships (without making in clear that you’ve also collected other data)

Question 13

Selective/inaccurate citing involves picking and choosing which ____ to cite in a way that fits your ____.
Or citing papers as ____ a specific ____ when they don’t.

Answer 13

papers, narrative
supporting, point

Question 14

Salami slicing is ____ relevant analyses from a single ____ into multiple ____ to increase ____ ____.

Answer 14

Splitting, dataset, papers, publication count

Question 15

What does QRPs stand for?

Answer 15

Questionable Research Practices

Question 16

In preregistration, what is done to prevent the following?
1. prevent HARKing - precise ____
2. prevent selective reporting - info about all ____ and how they’re ____
3. prevent p-hacking - detailed data ____ plan

Answer 16

1. Precise hypotheses
2. Info about all variables and how they’re operationalised
3. Detailed data analysis plan

Question 17

What are two positives of registered reports?
1. Improve ____ quality
2. More like to ____ publication ____

Answer 17

1. Improve research quality
2. More likely to reduce publication bias

Question 18

What do the following allow other researchers to do?
1. Open materials allow other researchers to ____ and more easily ____ your reserach study
2. Open code and data allow other researchers to ____ and ____ your reaearch findings

Answer 18

1. Inspect and more easily replicate your research study
2. Inspect and reproduce your research findings