Activation Function in Neural Networks
An Artificial neural network is a computational model developed on the basis of biological neural network. It represents the working of Human brain. It includes a large number of connected processing units that work to process information. These processing units are known as "neurons".This model will help us to know the importance of 'activation function' in biological neural network. And finally we end up with the knowledge of actual use of activation function in artificial neural network. A neuron has a physical structure that consists of a cell body, an axon that sends , messages to other neurons, and dendrites that receives signals or information from other neurons. Biological Neural Net In the above picture, the area between the two neurons where they communicate is known as synapse.The neuron receives signals from other neurons through dendrites. The weights (strength) associated with a dendrite,called synaptic weights , get multiplied by the in...