Base rate question Flashcards Preview

PSYC 820 - short answers > Base rate question > Flashcards

Flashcards in Base rate question Deck (15)
Loading flashcards...
1

Structure for this question?

1. Define concepts
2. Solve

2

What 7 concepts will I define?

1. Incremental validity
2. Base rate
3. Positive hit rate
4. True positive
5. True negative
6. False positive
7. False negative

3

What is incremental validity and who said so in what year and on what page?

"the extent to which a measure adds to the prediction of a criterion beyond what can be predicted with other data" (Hunsely, 2003, p. 443)

4

What is the formula for incremental validity?

positive hit rate - base rate = incremental validity

5

What is the base rate?

The probability of some event happening. In terms of testing, it can be defined as the probability that an individual within a population will have a certain characteristic

6

What is the formula for calculating the base rate?

(true positive + false negatives)/total number of people

7

What is the positive hit rate?

The proportion of scores that correctly classified the individuals in the population as having a certain characteristic

8

Give an example of positive hit rate from personnel selection.

the proportion of people hired who actually succeed on the job

9

What is the formula for calculating positive hit rate?

true positives/total positives

10

What is a true positive

An outcome where the model correctly predicts the positive class

11

What is a true negative

An outcome where the model correctly predicts the negative class

12

What is a false positive

An outcome where the model incorrectly predicts the positive class

13

What is a false negative

An outcome where the model incorrectly predicts the negative class

14

In terms of this question, what is the positive hit rate?

75/100 = .75

15

In terms of this question, what is the incremental validity?

.75-.30 = .45 = 45%