Fusion of physically-based registration and deformation modeling for nonrigid motion analysis

• Published in: IEEE transactions on image processing Vol. 10; no. 11; pp. 1659 - 1669
• Main Authors: Tsap, L.V., Goldgof, D.B., Sarkar, S.
• Format: Journal Article
• Language: English
• Published: New York, NY IEEE 01.11.2001; Institute of Electrical and Electronics Engineers; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Algorithm design and analysis; Applied sciences; Deformable models; Deformation; Exact sciences and technology; Finite element analysis; Finite element method; Finite element methods; Humans; Image processing; Information, signal and communications theory; Iterative algorithms; Material properties; Mathematical analysis; Mathematical models; Motion analysis; Sampling methods; Signal processing; Skin; Snakes; Studies; Telecommunications and information theory; Tracking; Finite element method; Hausdorff dimension; Motion estimation; Image processing; Multiscale method; Iterative method; Motion analysis; Modeling
• ISSN: 1057-7149; 1941-0042
• DOI: 10.1109/83.967394

In our previous work, we used finite element models to determine nonrigid motion parameters and recover unknown local properties of objects given correspondence data recovered with snakes or other tracking models. In this paper, we present a novel multiscale approach to recovery of nonrigid motion from sequences of registered intensity and range images. The main idea of our approach is that a finite element (FEM) model incorporating material properties of the object can naturally handle both registration and deformation modeling using a single model-driving strategy. The method includes a multiscale iterative algorithm based on analysis of the undirected Hausdorff distance to recover correspondences. The method is evaluated with respect to speed and accuracy. Noise sensitivity issues are addressed. Advantages of the proposed approach are demonstrated using man-made elastic materials and human skin motion. Experiments with regular grid features are used for performance comparison with a conventional approach (separate snakes and FEM models). It is shown, however, that the new method does not require a sampling/correspondence template and can adapt the model to available object features. Usefulness of the method is presented not only in the context of tracking and motion analysis, but also for a burn scar detection application.