Line of Sight Estimation for Interacting with Large Screens Virtual Environments

Large-screen virtual environments are an option to Head-Mounted Displays. However, head and gaze tracking are not always incorporated into these devices or require additional equipment to increase immersion sense. This work proposes estimating gaze by detecting face and irises points to compute the ocular plane and its normal. These values are used as an estimation of the line of sight. To compute the region or objects seen by the user, it is required, on one hand, the 3D position of the head in reference to the screen, which is provided by an RGB-D camera; and on the other hand, the knowledge of the scene being displayed. To incorporate these data an implementation over ROS and Gazebo simulator. Preliminary tests have been done to validate the proposal, and it is planned to evaluate immersion sense with external people in the future.