Terms crit

Question 1

Optional stopping

Answer 1

Checking results to decide whether to stop (p hacking isch)

Question 2

Multiple comparisons

Answer 2

Noisiness in data increases, type 1 error increases. Chance of finding sig result bigger but not really valid

Question 3

Confirmatory research

Answer 3

Pretty good idea about what outcome will be. (not a flat line in bayesian)

Question 4

Exploratory research

Answer 4

Not previously studied, not a good idea of what the outcome will be

Question 5

Conditional replication

Answer 5

Different set up but same concept. confirm whether the theoretical idea behind the findings is true, and under what conditions these findings will occur. How generalizable

Question 6

Direct replication

Answer 6

Same study different participants. Reliability of the research

Question 7

Motivated skeptisism

Answer 7

The mistake of applying more skepticism to claims that you don’t like (or intuitively disbelieve), than to claims that you do like.

Question 8

4 foolers Nuzzo

Answer 8

Texas Shooter - Drawing circle after shooting. Further research after seeing some result.

Hypothesis myopia - confirmation bias, looking for evidence for your hyp

Just-so story telling/jarking. Justifying after results are known. Post hoc story

Assymetric attention: happens when we give expected results a relatively free pass, but we rigorously check non-intuitive results

Question 9

Solutions

Answer 9

Strong inference, Transperency, Working together (team of Rivals) and blind data analysis