Multi-Feature Fusion in Particle Filter Framework for Visual Tracking

• Published in: IEEE sensors journal Vol. 20; no. 5; pp. 2405 - 2415
• Main Authors: Bhat, Pranab Gajanan, Subudhi, Badri Narayan, Veerakumar, T., Laxmi, Vijay, Gaur, Manoj Singh
• Format: Journal Article
• Language: English
• Published: New York IEEE 01.03.2020; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Algorithms; Color; Equations of motion; Feature extraction; fusion; Image color analysis; Iterative methods; KAZE; Kinematics; Machine learning; Matching; Mathematical model; Occlusion; Optical tracking; particle filter; Performance evaluation; Performance measurement; Similarity; Target tracking; Tracking; Visual tracking; Visualization
• ISSN: 1530-437X; 1558-1748
• DOI: 10.1109/JSEN.2019.2954331

In this article, a particle filter based tracking algorithm is proposed to track a target in video with vivid and complex environments. The target is represented in feature space by both color distribution and KAZE features. Color distribution is selected for its robustness to target's scale variation and partial occlusion. KAZE features are chosen for their ability to represent the target structure and also for their superior performance in feature matching. Fusion of these two features will lead to effective tracking as compared to other features due to their better representational abilities, under challenging conditions. The trajectory of the target is established using the particle filter algorithm based on similarity between the extracted features from the target and the probable candidates in the consecutive frames. For the color distribution model, Bhattacharya coefficient is used as a similarity metric whereas Nearest Neighbor Distance Ratio is used for matching of corresponding feature points in KAZE algorithm. The particle filter update model is based on kinematic motion equations and the weights on particles are governed by an equation fusing both the color and KAZE features. Centre Location Error, Average Tracking Accuracy and Tracking Success Rate are the performance metrics considered in the evaluation process. Also, the overlap success plot and precision plot is considered for performance evaluation. On the basis of these metrics and visual results obtained under different environment conditions: outdoor, occluding and underwater ones, the proposed tracking scheme performs significantly better than the contemporary feature-based iterative object tracking methods and even few of the learning-based algorithms.