Multi-frame super-resolution reconstruction of small moving objects

• Published in: IEEE transactions on image processing Vol. 19; no. 11; p. 2901
• Main Authors: van Eekeren, Adam W M, Schutte, Klamer, van Vliet, Lucas J
• Format: Journal Article
• Language: English
• Published: United States 01.11.2010
• ISSN: 1941-0042; 1941-0042
• DOI: 10.1109/TIP.2010.2068210

Multiframe super-resolution (SR) reconstruction of small moving objects against a cluttered background is difficult for two reasons: a small object consists completely of “mixed” boundary pixels and the background contribution changes from frame-to-frame. We present a solution to this problem that greatly improves recognition of small moving objects under the assumption of a simple linear motion model in the real-world. The presented method not only explicitly models the image acquisition system, but also the space-time variant fore- and background contributions to the “mixed” pixels. The latter is due to a changing local background as a result of the apparent motion. The method simultaneously estimates a subpixel precise polygon boundary as well as a high-resolution (HR) intensity description of a small moving object subject to a modified total variation constraint. Experiments on simulated and real-world data show excellent performance of the proposed multiframe SR reconstruction method.