# Lecture 7 – Fitted modelling Flashcards

1
Q

What is regression?

A

looking for relationships amongst variables

2
Q

Purpose of using regression?

A
• to determine how multiple variables are related
• to predict a value
3
Q

What is polynomial regression?

A

fitting a curve defined by a polynomial function to data

4
Q

What is bias?

A

measures how much the prediction differs from the desired regression function

5
Q

What is variance?

A

measure how much the predictions for individual data sets vary around their average

6
Q

Describe the bias vs variance tradeoff
(With graph)

A

Underfitting happens when a model unable to capture the underlying pattern of the data. These models usually have high bias and low variance.

Overfitting happens when our model captures the noise along with the underlying pattern in data. It happens when we train our model a lot over noisy dataset. These models have low bias and high variance.

7
Q

What does the “no free lunch theorem” state?

A

If a learning algorithm performs well and a certain class of problem then it necessarily pays for that with lower performance on all other problems

8
Q

How can an ensemble be used in prediction?

A

ensemble = multiple models applied to the same problem
prediction result = average / majority vote of the ensemble