LessMissed: Screenshot-Grounded Element Identity Resolution for Browser-Based Webcam Eye Tracking

LessMissed is a browser-based system for resolving which visible web element corresponds to a user's gaze during webcam-based eye tracking. The system combines browser-native element acquisition with screenshot-grounded identity resolution to address a key ambiguity in DOM-based gaze tracking: overlays and composited interface layers can intercept point queries even when the visually intended target lies underneath. A Manifest V3 browser extension records element metadata and gaze-related coordinates, while a screenshot pipeline provides visual context for resolving the intended interface region. The proposed resolver uses DOM hit testing, ancestor traversal, geometric containment, and screenshot-derived regions to identify the most plausible visible target. In a controlled evaluation on a 1440 × 900 viewport, the proposed stack-walking resolver avoided overlay misattribution and agreed with browser-derived ground truth across the tested grid positions. The study demonstrates the feasibility of combining browser semantics with screenshot evidence for more reliable web-element identity resolution, while leaving end-to-end user gaze accuracy as future work.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-09-05
DOI
https://doi.org/10.5281/zenodo.22312931
Primary Topic
Gaze Tracking and Assistive Technology
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
preprint

LessMissed: Screenshot-Grounded Element Identity Resolution for Browser-Based Webcam Eye Tracking

Anusha Sarkar, Ashish Kumar, Abhinav Anand, Devashree Palav
Zenodo (CERN European Organization for Nuclear Research)
Gaze Tracking and Assistive Technology
preprint

LessMissed: Screenshot-Grounded Element Identity Resolution for Browser-Based Webcam Eye Tracking

Anusha Sarkar, Ashish Kumar, Abhinav Anand, Devashree Palav
preprint en

Abstract

LessMissed is a browser-based system for resolving which visible web element corresponds to a user's gaze during webcam-based eye tracking. The system combines browser-native element acquisition with screenshot-grounded identity resolution to address a key ambiguity in DOM-based gaze tracking: overlays and composited interface layers can intercept point queries even when the visually intended target lies underneath. A Manifest V3 browser extension records element metadata and gaze-related coordinates, while a screenshot pipeline provides visual context for resolving the intended interface region. The proposed resolver uses DOM hit testing, ancestor traversal, geometric containment, and screenshot-derived regions to identify the most plausible visible target. In a controlled evaluation on a 1440 × 900 viewport, the proposed stack-walking resolver avoided overlay misattribution and agreed with browser-derived ground truth across the tested grid positions. The study demonstrates the feasibility of combining browser semantics with screenshot evidence for more reliable web-element identity resolution, while leaving end-to-end user gaze accuracy as future work.

Zenodo (CERN European Organization for Nuclear Research)
Somaiya Vidyavihar University (IN)
Peace, Justice and strong institutions
Gaze Tracking and Assistive Technology
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.