Line of Sight Estimation for Interacting with Large Screens Virtual Environments

Large-screen virtual environments are an option to Head-Mounted Displays. However, head and gaze tracking are not always incorporated into these devices or require additional equipment to increase immersion sense. This work proposes estimating gaze by detecting face and irises points to compute the...

Full description

Saved in:
Bibliographic Details
Published in2024 IEEE 3rd International Conference on Intelligent Reality (ICIR) pp. 1 - 5
Main Authors Aramburo-Aguilar, Jorge, Hernandez-Sanchez, Atalia Yael, Reyes-Montiel, Jeeangh Jennessi, Hermosilla-Diaz, Jesus Eduardo, Marin-Hernandez, Antonio
Format Conference Proceeding
LanguageEnglish
Published IEEE 05.12.2024
Subjects
Cameras
Estimation
Faces
Gaze tracking
Hands
HCl
Head Tracking
Head-mounted displays
Intelligent Virtual Environments
Line of Sigth
MediaPipe
Proposals
Three-dimensional displays
Virtual environments
Online AccessGet full text

Cover

More Information
Summary:Large-screen virtual environments are an option to Head-Mounted Displays. However, head and gaze tracking are not always incorporated into these devices or require additional equipment to increase immersion sense. This work proposes estimating gaze by detecting face and irises points to compute the ocular plane and its normal. These values are used as an estimation of the line of sight. To compute the region or objects seen by the user, it is required, on one hand, the 3D position of the head in reference to the screen, which is provided by an RGB-D camera; and on the other hand, the knowledge of the scene being displayed. To incorporate these data an implementation over ROS and Gazebo simulator. Preliminary tests have been done to validate the proposal, and it is planned to evaluate immersion sense with external people in the future.
DOI:10.1109/ICIR64558.2024.10976890