Model Checking Flashcards

(10 cards)

1
Q

What is the main difference between model selection and traditional hypothesis testing?

A

Model selection compares many models at once to find the best balance of fit and simplicity, while traditional hypothesis testing compares one model against a null hypothesis.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What does AIC measure?

A

AIC measures the quality of a model based on its goodness of fit and complexity (number of parameters).

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Why is a lower AIC better?

A

Because it indicates a model that fits the data well with fewer parameters, avoiding overfitting.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What does ΔAIC tell you?

A

ΔAIC is the difference between a model’s AIC and the best model’s AIC, indicating how close or far it is from the best model.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is model averaging, and when should you use it?

A

Model averaging combines predictions or estimates from multiple models weighted by their AIC weights, used when no single model is clearly the best.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What is the purpose of log-likelihood in model comparison?

A

Log-likelihood quantifies how well the model explains the data and is used in calculating AIC.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

If two models have a ΔAIC less than 2, what should you consider?

A

Consider that both models have similar support and it might be better to use model averaging.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What does AIC penalize, and why?

A

AIC penalizes models with more parameters to avoid overfitting.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is an advantage of using all-subsets model selection?

A

It tests all possible variable combinations, ensuring you find the best model among all options.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

How do AIC weights help in model interpretation?

A

They estimate the probability that each model is the best among the candidates, helping to weigh models in inference.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly