A Generalized Forward-Backward Splitting

• Published in: SIAM journal on imaging sciences Vol. 6; no. 3; pp. 1199 - 1226
• Main Authors: Raguet, Hugo, Fadili, Jalal, Peyre, Gabriel
• Format: Journal Article
• Language: English
• Published: Philadelphia Society for Industrial and Applied Mathematics 01.01.2013
• Subjects: Algorithms; Computation; Computer Science; Engineering Sciences; Imaging; Mathematical analysis; Mathematical models; Mathematics; Operators; Optimization and Control; Proximity; Signal and Image processing; Splitting; splitting; image processing; wavelets; convex optimization; proximal; total variation; Forward-backward algorithm
• ISSN: 1936-4954; 1936-4954
• DOI: 10.1137/120872802

This paper introduces a generalized forward-backward splitting algorithm for finding a zero of a sum of maximal monotone operators $B + \sum_{i=1}^n A_i$, where $B$ is cocoercive. It involves the computation of $B$ in an explicit (forward) step and the parallel computation of the resolvents of the $A_i$'s in a subsequent implicit (backward) step. We prove the algorithm's convergence in infinite dimension and its robustness to summable errors on the computed operators in the explicit and implicit steps. In particular, this allows efficient minimization of the sum of convex functions $f + \sum_{i=1}^n g_i$, where $f$ has a Lipschitz-continuous gradient and each $g_i$ is simple in the sense that its proximity operator is easy to compute. The resulting method makes use of the regularity of $f$ in the forward step, and the proximity operators of the $g_i$'s are applied in parallel in the backward step. While the forward-backward algorithm cannot deal with more than $n = 1$ nonsmooth function, we generalize it to the case of arbitrary $n$. Examples on inverse problems in imaging demonstrate the advantage of the proposed methods in comparison to other splitting algorithms. [PUBLICATION ABSTRACT]