A Cutting Surface Algorithm for Semi-Infinite Convex Programming with an Application to Moment Robust Optimization

• Published in: SIAM journal on optimization Vol. 24; no. 4; pp. 1670 - 1697
• Main Authors: Mehrotra, Sanjay, Papp, Dávid
• Format: Journal Article
• Language: English
• Published: United States SIAM 01.01.2014
• Subjects: Algorithms; column generation; Convergence; Cutting; cutting plane methods; cutting surface methods; distributionally robust optimization; Hierarchies; MATHEMATICS AND COMPUTING; moment matching; moment problem; Optimization; Probability theory; Programming; robust optimization; semi-infinite programming; stochastic programming; Uncertainty
• ISSN: 1052-6234; 1095-7189
• DOI: 10.1137/130925013

We present and analyze a central cutting surface algorithm for general semi-infinite convex optimization problems and use it to develop a novel algorithm for distributionally robust optimization problems in which the uncertainty set consists of probability distributions with given bounds on their moments. Moments of arbitrary order, as well as nonpolynomial moments, can be included in the formulation. We show that this gives rise to a hierarchy of optimization problems with decreasing levels of risk-aversion, with classic robust optimization at one end of the spectrum and stochastic programming at the other. Although our primary motivation is to solve distributionally robust optimization problems with moment uncertainty, the cutting surface method for general semi-infinite convex programs is also of independent interest. The proposed method is applicable to problems with nondifferentiable semi-infinite constraints indexed by an infinite dimensional index set. Examples comparing the cutting surface algorithm to the central cutting plane algorithm of Kortanek and No demonstrate the potential of our algorithm even in the solution of traditional semi-infinite convex programming problems, whose constraints are differentiable, and are indexed by an index set of low dimension. After the rate of convergence analysis of the cutting surface algorithm, we extend the authors' moment matching scenario generation algorithm to a probabilistic algorithm that finds optimal probability distributions subject to moment constraints. The combination of this distribution optimization method and the central cutting surface algorithm yields a solution to a family of distributionally robust optimization problems that are considerably more general than the ones proposed to date.