Week 2 Flashcards
Define a discriminate function
Math def of dichotomizer discriminating function
Def linear discriminant function
What is a linear machine
Categorisation rule for dichotomiser
What is ‘augmenting’ a vector
Extend a vector/matrix by adding elements to it
Generalised linear Discriminant function
Quadratic discriminant function
Generalised n dim discriminant function
Formulate problem of learning linear discriminant functions
Where each a is a vector of weights w
2 category linearly separable case correctly classified
2 category linearly separable case (sample normalisation)
2 category linearly separable case - margin
Gradient descent procedure
Perceptron criterion function
Batch perceptron learning algorithm
The new weight vector is obtained by summing the feature vectors associated with all misclassified samples and adding some multiple of this to the currrent weight vector
Sequential perceptron learning algo
Multi class perceptron learning algorithm
Compare Minimum Squared Error to perceptron learning procedure
MSE via pseudo inverse
MSE via gradient descent
Widrow Hoff (LMS)
Sequential widrow hoff
What is an epoch
1 pass through all the training data
