Flashcards in Base rate question Deck (15)

Loading flashcards...

1

## Structure for this question?

###
1. Define concepts

2. Solve

2

## What 7 concepts will I define?

###
1. Incremental validity

2. Base rate

3. Positive hit rate

4. True positive

5. True negative

6. False positive

7. False negative

3

## What is incremental validity and who said so in what year and on what page?

### "the extent to which a measure adds to the prediction of a criterion beyond what can be predicted with other data" (Hunsely, 2003, p. 443)

4

## What is the formula for incremental validity?

### positive hit rate - base rate = incremental validity

5

## What is the base rate?

### The probability of some event happening. In terms of testing, it can be defined as the probability that an individual within a population will have a certain characteristic

6

## What is the formula for calculating the base rate?

### (true positive + false negatives)/total number of people

7

## What is the positive hit rate?

### The proportion of scores that correctly classified the individuals in the population as having a certain characteristic

8

## Give an example of positive hit rate from personnel selection.

### the proportion of people hired who actually succeed on the job

9

## What is the formula for calculating positive hit rate?

### true positives/total positives

10

## What is a true positive

### An outcome where the model correctly predicts the positive class

11

## What is a true negative

### An outcome where the model correctly predicts the negative class

12

## What is a false positive

### An outcome where the model incorrectly predicts the positive class

13

## What is a false negative

### An outcome where the model incorrectly predicts the negative class

14

## In terms of this question, what is the positive hit rate?

### 75/100 = .75

15