sigmoid activation function

A sigmoid activation function is used in many neural networks. The properties of a sigmoid function mean that it shares some of the non-lonearity of a threshold function, but is differentiable enabling learning through the backpropagation algorithm.