An appearance-based representation of action

• Published in: Proceedings of 13th International Conference on Pattern Recognition Vol. 1; pp. 307 - 312 vol.1
• Main Authors: Bobick, A., Davis, J.
• Format: Conference Proceeding
• Language: English; Japanese
• Published: IEEE 1996
• Subjects: Computer vision; Distributed computing; Humans; Image reconstruction; Image sequences; Impedance matching; Laboratories; Proposals; Testing; Video sequences
• ISBN: 9780818672828; 081867282X
• ISSN: 1051-4651
• DOI: 10.1109/ICPR.1996.546039

A new view-based approach to the representation of action is presented. Our underlying representations are view-based descriptions of the coarse image motion associated with viewing given actions from particular directions. Using these descriptions, we propose an appearance-based action-recognition strategy comprised of two stages: 1) a motion energy image (MEI) is computed that grossly describes the spatial distribution of motion energy for a given view of a given action, and the input MEI is matched against stored models which span the range of views of known actions; 2) any models that plausibly match the input are tested for a coarse, categorical agreement between a stored motion model of the action and a parametrization of the input motion. Using a "sitting" action as an example, and using a manually placed stick model, we develop a representation and verification technique that collapses the temporal variations of the motion parameters into a single, low-order vector.