arXiv:2308.05059 [cs.LG]AbstractReferencesReviewsResources
A Novel Method for improving accuracy in neural network by reinstating traditional back propagation technique
Published 2023-08-09Version 1
Deep learning has revolutionized industries like computer vision, natural language processing, and speech recognition. However, back propagation, the main method for training deep neural networks, faces challenges like computational overhead and vanishing gradients. In this paper, we propose a novel instant parameter update methodology that eliminates the need for computing gradients at each layer. Our approach accelerates learning, avoids the vanishing gradient problem, and outperforms state-of-the-art methods on benchmark data sets. This research presents a promising direction for efficient and effective deep neural network training.
Related articles: Most relevant | Search more
arXiv:2307.09988 [cs.LG] (Published 2023-07-19)
TinyTrain: Deep Neural Network Training at the Extreme Edge
arXiv:1711.11071 [cs.LG] (Published 2017-11-29)
HSC: A Novel Method for Clustering Hierarchies of Networked Data
arXiv:1706.00043 [cs.LG] (Published 2017-05-31)
Biased Importance Sampling for Deep Neural Network Training