Deep Attention Network for Egocentric Action Recognition

• Published in: IEEE transactions on image processing Vol. 28; no. 8; pp. 3703 - 3713
• Main Authors: Lu, Minlong, Li, Ze-Nian, Wang, Yueming, Pan, Gang
• Format: Journal Article
• Language: English
• Published: United States IEEE 01.08.2019; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: action recognition; Artificial neural networks; Attention - physiology; Attention network; Cameras; Data models; Databases, Factual; egocentric vision; Head; Human Activities - classification; Human behavior; Humans; Image Processing, Computer-Assisted - methods; LSTM; Moving object recognition; Neural Networks, Computer; Pattern Recognition, Automated - methods; Predictive models; Recognition; Streaming media; Task analysis; top-down attention; Videos

Recognizing a camera wearer's actions from videos captured by an egocentric camera is a challenging task. In this paper, we employ a two-stream deep neural network composed of an appearance-based stream and a motion-based stream to recognize egocentric actions. Based on the insight that human a...