Modelling Spatio-Temporal Saliency to Predict Gaze Direction for Short Videos

• Published in: International journal of computer vision Vol. 82; no. 3; pp. 231 - 243
• Main Authors: Marat, Sophie, Ho Phuoc, Tien, Granjon, Lionel, Guyader, Nathalie, Pellerin, Denis, Guérin-Dugué, Anne
• Format: Journal Article
• Language: English
• Published: Boston Springer US 01.05.2009; Springer; Springer Nature B.V; Springer Verlag
• Subjects: Applied sciences; Artificial Intelligence; Computer Imaging; Computer Science; Computer science; control theory; systems; Engineering Sciences; Exact sciences and technology; Eye movements; Image Processing and Computer Vision; Pattern Recognition; Pattern Recognition and Graphics; Pattern recognition. Digital image processing. Computational geometry; Short Paper; Signal and Image processing; Vision; Gaze prediction; Saliency; Spatio-temporal model; Video viewing; Streaming; Visual system; Gaze; Image processing; Video signal; Very large databases; Spatio-temporal model . Gaze prediction . Video viewing; Retina; Biology; Modeling; Eye movement

This paper presents a spatio-temporal saliency model that predicts eye movement during video free viewing. This model is inspired by the biology of the first steps of the human visual system. The model extracts two signals from video stream corresponding to the two main outputs of the retina: parvoc...