Predicting Head Movement in Panoramic Video: A Deep Reinforcement Learning Approach

• Published in: IEEE transactions on pattern analysis and machine intelligence Vol. 41; no. 11; pp. 2693 - 2708
• Main Authors: Xu, Mai, Song, Yuhang, Wang, Jianyi, Qiao, Minglang, Huo, Liangyu, Wang, Zulin
• Format: Journal Article
• Language: English
• Published: United States IEEE 01.11.2019; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Algorithms; deep learning; Field of view; Head movement; Hidden Markov models; Human motion; Interactive control; Machine learning; Panoramic video; Performance enhancement; Predictions; Predictive models; reinforcement learning; Saliency detection; Two dimensional displays; Visualization

Panoramic video provides immersive and interactive experience by enabling humans to control the field of view (FoV) through head movement (HM). Thus, HM plays a key role in modeling human attention on panoramic video. This paper establishes a database collecting subjects' HM in panoramic video...