A sequence-based extension of mean-field annealing using the forward/backward algorithm: application to image segmentation

• Published in: IEEE transactions on signal processing Vol. 51; no. 10; pp. 2692 - 2705
• Main Authors: Miller, D.J., Qi Zhao
• Format: Journal Article
• Language: English
• Published: New York, NY IEEE 01.10.2003; Institute of Electrical and Electronics Engineers; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Algorithms; Annealing; Applied sciences; Convergence; Costs; Entropy; Exact sciences and technology; Image processing; Image segmentation; Information, signal and communications theory; Iterative algorithms; Labeling; Lagrangian functions; Marking; Mathematical models; Optimization; Optimization methods; Pixel; Pixels; Segmentation; Signal processing; Studies; Telecommunications and information theory; Random field; Image segmentation; mean-field annealing; Mean field approximation; Image processing; Forward/Backward (F/B) Algorithm; Markov model; Markov random field; Deterministic annealing; Algorithm; Optimization
• ISSN: 1053-587X; 1941-0476
• DOI: 10.1109/TSP.2003.816770

Optimization based on mean-field theory, including mean-field annealing (MFA), is widely used for discrete optimization (label assignment) problems defined on the pixel sites of an image. One formulation of MFA is via maximum entropy, where one seeks the joint distribution over the (random) assignments subject to an average level of cost. MFA is obtained by assuming the assignments at each pixel are statistically independent, given the observed image. Alternatively, we make the less restrictive assumption of independent row labelings. The independence assumption means that at each step, MFA optimizes over only one pixel, whereas our method jointly optimizes over an entire row, i.e., our method is less greedy. In principle, an MFA extension could be developed that explicitly re-estimates the row labeling distributions, but such an approach is, in practice, infeasible. Even so, we can indirectly implement this re-estimation, by re-estimating quantities that determine the row labeling distributions. These quantities are the a posteriori site probabilities, re-estimable via the well-known forward/backward (F/B) algorithm. Thus, our algorithm, which descends in the ME Lagrangian/free energy, consists of iterative application of F/B to the image rows (columns). At convergence, maximum a posteriori site labeling is performed. Our method was applied to segmentation of both real and synthetic noise-corrupted images. It achieved lower Markov random field model potentials and better segmentations compared with other methods, and, in high noise, standard MFA.