Week 8 (basis function models & Regularisation) Flashcards

(12 cards)

1
Q

Linear basis function model

A

The linearity is of the basis functions’ weights, not the functions themselves

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Gaussian basis function

A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Polynomial basis function

A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Sigmoidal basis functions

A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Derive likelihood function for linear basis functions

A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Derive SSE for linear basis functions

A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Least squares for linear basis function

A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Geometry of least squares for linear basis function

A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Least mean squares algorithm (linear basis functions)

A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Regularized least squares and how to minimise (for linear basis function)

A

Where E_W(W) depends on problem specification. (eg in this case it is L2 norm)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Generalised regularizer

A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Bias Variance decomposition

A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly