A Newton-CG based barrier-augmented Lagrangian method for general nonconvex conic optimization

• Published in: Computational optimization and applications Vol. 89; no. 3; pp. 843 - 894
• Main Authors: He, Chuan, Huang, Heng, Lu, Zhaosong
• Format: Journal Article
• Language: English
• Published: New York Springer US 01.12.2024
• Subjects: Convex and Discrete Geometry; Management Science; Mathematics; Mathematics and Statistics; Operations Research; Operations Research/Decision Theory; Optimization; Statistics; Augmented Lagrangian method; 68Q25; Operation complexity; 90C26; Newton-conjugate gradient method; Iteration complexity; Barrier method; 90C30; Nonconvex conic optimization; 49M05; 49M15; Second-order stationary point; 90C60
• ISSN: 0926-6003; 1573-2894; 1573-2894
• DOI: 10.1007/s10589-024-00603-6

In this paper we consider finding an approximate second-order stationary point (SOSP) of general nonconvex conic optimization that minimizes a twice differentiable function subject to nonlinear equality constraints and also a convex conic constraint. In particular, we propose a Newton-conjugate gradient (Newton-CG) based barrier-augmented Lagrangian method for finding an approximate SOSP of this problem. Under some mild assumptions, we show that our method enjoys a total inner iteration complexity of O ~ ( ϵ - 11 / 2 ) and an operation complexity of O ~ ( ϵ - 11 / 2 min { n , ϵ - 5 / 4 } ) for finding an ( ϵ , ϵ ) -SOSP of general nonconvex conic optimization with high probability. Moreover, under a constraint qualification, these complexity bounds are improved to O ~ ( ϵ - 7 / 2 ) and O ~ ( ϵ - 7 / 2 min { n , ϵ - 3 / 4 } ) , respectively. To the best of our knowledge, this is the first study on the complexity of finding an approximate SOSP of general nonconvex conic optimization. Preliminary numerical results are presented to demonstrate superiority of the proposed method over first-order methods in terms of solution quality.