Using physics engines to track objects in images

• Published in: 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro pp. 1342 - 1345
• Main Authors: de Chaumont, F., Dufour, A., Serreau, P., Chabout, J., Munter, S., Frischknecht, F., Granon, S., Olivo-Marin, J.-C.
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.06.2009
• Subjects: Deformable models; Engines; Force control; Interference constraints; Mean-shift; Mice; Physics; Physics engines; Reflection; Shape; Solid modeling; Tracking; Video sequences
• ISBN: 1424439310; 9781424439317
• ISSN: 1945-7928; 1945-8452
• DOI: 10.1109/ISBI.2009.5193313

This paper tackles the problem of tracking multiple articulated objects undergoing frequent contacts in a video sequence. Conventional tracking methods usually fail to distinguish objects during contact, implying the use of disambiguation techniques to recover the identity of each object. Moreover, such methods do not provide detailed shape information at the articulation level. We address these limitations by proposing a novel approach to track multiple articulated objects using the mean-shift technique and physics engines. By defining a model of each object using geometrical primitives and physical constraints, we exploit the physics engine force solver as a control layer of the mean-shift process and follow the model and its deformation along the sequence. The method is applied to track mice observed with a webcam and two sporozoites observed in reflection interference contrast microscopy, highlighting the flexibility and genericity of the framework.