A primal-dual penalty method via rounded weighted-ℓ1 Lagrangian duality

• Published in: Optimization Vol. 71; no. 13; pp. 3981 - 4017
• Main Authors: Burachik, R. S., Kaya, C. Y., Price, C. J.
• Format: Journal Article
• Language: English
• Published: Philadelphia Taylor & Francis 09.12.2022; Taylor & Francis LLC
• Subjects: Asymptotic properties; Constraints; Kissing number problem; Markov-Dubins problem; Optimization; Penalty function; penalty function methods; Polynomials; primal-dual methods; Solvers
• ISSN: 0233-1934; 1029-4945
• DOI: 10.1080/02331934.2021.1934680

We propose a new duality scheme based on a sequence of smooth minorants of the weighted- penalty function, interpreted as a parametrized sequence of augmented Lagrangians, to solve non-convex constrained optimization problems. For the induced sequence of dual problems, we establish strong asymptotic duality properties. Namely, we show that (i) the sequence of dual problems is convex and (ii) the dual values monotonically increase to the optimal primal value. We use these properties to devise a subgradient based primal-dual method, and show that the generated primal sequence accumulates at a solution of the original problem. We illustrate the performance of the new method with three different types of test problems: A polynomial non-convex problem, large-scale instances of the celebrated kissing number problem, and the Markov-Dubins problem. Our numerical experiments demonstrate that, when compared with the traditional implementation of a well-known smooth solver, our new method (using the same well-known solver in its subproblem) can find better quality solutions, i.e. 'deeper' local minima, or solutions closer to the global minimum. Moreover, our method seems to be more time efficient, especially when the problem has a large number of constraints.