Nonlinear backpropagation: doing backpropagation without derivatives of the activation function

John A. Hertz, Anders Krogh, Benny Lautrup, Torsten Lehmann. Nonlinear backpropagation: doing backpropagation without derivatives of the activation function. IEEE Transactions on Neural Networks, 8(6):1321-1327, 1997. [doi]

@article{HertzKLL97,
  title = {Nonlinear backpropagation: doing backpropagation without derivatives of the activation function},
  author = {John A. Hertz and Anders Krogh and Benny Lautrup and Torsten Lehmann},
  year = {1997},
  doi = {10.1109/72.641455},
  url = {http://dx.doi.org/10.1109/72.641455},
  researchr = {https://researchr.org/publication/HertzKLL97},
  cites = {0},
  citedby = {0},
  journal = {IEEE Transactions on Neural Networks},
  volume = {8},
  number = {6},
  pages = {1321-1327},
}