Resampling Flashcards

1
Q

Test error

A

The test error is the average error that results from using a statistical learning method to predict the response on a new observation, one that was not used in training the method.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Training Error

A

In contrast, the training error can be easily calculated by applying the statistical learning method to the observations used in its training.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Which error dramatically underestimates the other?

A

Training error to Test error

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Training- versus Test-Set Performance

A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Validation-set approach

A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Drawback of Validation set approach

A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

K-fold Cross-validation

A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

K-fold Cross-validation in detail

A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

The Bootstrap

A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly