Understanding the acceleration phenomenon via high-resolution differential equations - Shi, Bin; Du, Simon S.; Jordan, Michael I.; Su, Weijie J. (Mathematical programming, 2022)
Keywords: Algorithms; Calculus of Variations and Optimal Control; Optimization; Combinatorics; Constraining; Convergence; Convex analysis; Differential equations; Full Length Paper; High resolution; Liapunov functions; Mathematical analysis; Mathematical and Computational Physics; Mathematical Methods in Physics; Mathematical optimization; Mathematics; Mathematics and Statistics; Mathematics of Computing; Numerical Analysis; Optimization; Ordinary differential equations; Theoretical; Nesterov’s accelerated gradient methods; 65P10; 34E10; Ordinary differential equation; First-order method; Polyak’s heavy ball method; 90C30; 93D05; Convex optimization; 90C25; 65L20; Gradient minimization; Lyapunov function