LEARN SHIT Flashcards
(2 cards)
1
Q
How to construct jacobian matrix for activation function
A
diagonal matrix with derivative of actication funciton on top and w.r.t to x_i
2
Q
backprop gradient for weights
A
where a is the previous activation func