Archive for June 25, 2008

The Cybenko theorem for neural networks

This theorem is a very important one in the neural nets theory.
Indeed, in 1989, George Cybenko proved that a single hidden layer feed forward neural network can approximate any continuous and multivariate function.

Moreover, he also proved that a failure with such neural nets would be caused by bad weights or learning rate, etc.
This theorem helps [...]