Category: Bishop

When we think about learning the parameters of a neural network, we naturally think of gradient descent, because what else can we really do? It turns out that there is something else we can do, namely function evaluation, but that gradient descent, at least in a neural network setting, can be enormously more efficient. I…