For now this section only has information on the gradient descent algorithm.
Activation Functions
Optimization & backpropagation
Mathematical Foundations
Resources & references