Likelihood Flashcards
(8 cards)
1
Q
What is conditional likelihood?
A
Py(i) = P(y(i)|x(i), w) where y(i) ∈ {0, 1}
2
Q
What is joint conditional likelihood?
A
Π P y(i) = p(y|x, w)
3
Q
Why is likelihood used?
A
Likelihood is used when trying to determine if parameters are good given the data.
4
Q
What is the maximum likelihood formula?
A
L(w) = Π P y(i)
5
Q
What is the log likelihood function?
A
ln(L(w)) = Σ ln P y(i)
6
Q
What is the function for minimising loss?
A
argmin w E(w) = - ln(L(w))
7
Q
What is cross-entropy?
A
Cross-entropy is a measure of dissimilarity between two probabilities, or between the true and the learned distributions.
8
Q
What is the formula for cross-entropy?
A
E(w) = - Σ y(i) ln p(1|x(i), w) + (1-y(i)) ln p(0|x(i), w)
