diffGrad: An Optimization Method for Convolutional Neural Networks - Dubey, Shiv Ram; Chakraborty, Soumendu; Roy, Swalpa Kumar; Mukherjee, Snehasis; Singh, Satish Kumar; Chaudhuri, Bidyut Baran (IEEE transaction on neural networks and learning systems, 2020)
Keywords: Adaptive moment estimation (Adam); Artificial neural networks; Computer vision; Convergence; difference of gradient; Estimation; Experiments; gradient descent; image classification; Machine learning; Neural networks; Optimization; Optimization methods; Optimization techniques; Parameters; residual network; Source code; Stochasticity; Training