1
Q
What is Initialization?
A
The process in which we set the initial values of weights
2
Q
What happens if you have an inappropriate initialization?
A
you end up with an unoptimizable model
3
Q
How do we initialize the weights?
A
- Equal probability of being selected
- Non linearity - sigmoid
4
Q
What is Xavier initialization?
A
or Glorot Initialization
