A line based pose representation for human action recognition

• Published in: Signal processing. Image communication Vol. 28; no. 5; pp. 458 - 471
• Main Authors: Baysal, Sermetcan, Duygulu, Pınar
• Format: Journal Article
• Language: English
• Published: Elsevier B.V 01.05.2013
• Subjects: Action recognition; Human motion; Line-flow; Pose matching; Pose similarity; Action recognition; Line-flow; Human motion; Pose matching; Pose similarity
• ISSN: 0923-5965; 1879-2677
• DOI: 10.1016/j.image.2013.01.005

In this paper, we utilize a line based pose representation to recognize human actions in videos. We represent the pose in each frame by employing a collection of line-pairs, so that limb and joint movements are better described and the geometrical relationships among the lines forming the human figure are captured. We contribute to the literature by proposing a new method that matches line-pairs of two poses to compute the similarity between them. Moreover, to encapsulate the global motion information of a pose sequence, we introduce line-flow histograms, which are extracted by matching line segments in consecutive frames. Experimental results on Weizmann and KTH datasets emphasize the power of our pose representation, and show the effectiveness of using pose ordering and line-flow histograms together in grasping the nature of an action and distinguishing one from the others. ► Utilize a line based pose representation to recognize human actions. ► Represent poses by a collection of line-pairs. ► Propose a new method to compute the similarity between two poses. ► Introduce line-flow histograms to encapsulate global motion of a pose sequence.