Dr. Nazri Mohd Nawi, Rozaida Ghazali, Mohd Najib B. Mohd Salleh. The Development of Improved Back-Propagation Neural Networks Algorithm for Predicting Patients with Heart Disease. In Rongbo Zhu, Yanchun Zhang, Baoxiang Liu, Chunfeng Liu, editors, Information Computing and Applications - First International Conference, ICICA 2010, Tangshan, China, October 15-18, 2010. Proceedings. Volume 6377 of Lecture Notes in Computer Science, pages 317-324, Springer, 2010. [doi]
A study on improving training efficiency of Artificial Neural Networks algorithm was carried out throughout many previous papers. This paper presents a new approach to improve the training efficiency of back propagation neural network algorithms. The proposed algorithm (GDM/AG) adaptively modifies the gradient based search direction by introducing the value of gain parameter in the activation function. It has been shown that this modification significantly enhance the computational efficiency of training process. The proposed algorithm is generic and can be implemented in almost all gradient based optimization processes. The robustness of the proposed algorithm is shown by comparing convergence rates and the effectiveness of gradient descent methods using the proposed method on heart disease data.