Deep learning and neural networks

This project is still very much work in progress. Below you'll find links to my notes on subjects related to neural networks and deep learning.

Activation functions

The discussion of activation functions in artificial neural networks includes a crash introduction to biological neural nets and explains how they have provided inspiration for the artificial neurons that constitute the building blocks of artificial neural networks. Finally some of the most widely used activation functions are introduced, including:

• The sigmoid function (also known as the logistic function)