Uppmärksamhetsanalys i en Mixed Reality-miljö

This thesis explores how user attention in mixed reality can be analysed by combining eye tracking with object detection. A real-time module was developed for Microsoft HoloLens 2 to capture gaze data, project fixation points onto videoframes, and check for overlaps with detected objects. In this context, “attention” is defined as the user’s visual focus point. The module streams video and gaze data to a YOLOv5 object detection server. Due to hardware constraints, the server processes around 3 frames per second, which is lower than ideal for real-time applications. A user study was conducted in a controlled environment containing both virtual and physical objects. No explicit instructions were given about task elements to avoid influencing natural attention patterns.The module detects object-gaze overlaps and records metrics like fixation duration and object distance. While performance is currently limited by processing speed, the module demonstrates a working prototype for analysing gaze behaviour in mixed reality environments.

Publication Details

Journal
KTH Publication Database DiVA (KTH Royal Institute of Technology)
Published
2025-01-01
Primary Topic
Gaze Tracking and Assistive Technology
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Uppmärksamhetsanalys i en Mixed Reality-miljö

KTH Publication Database DiVA (KTH Royal Institute of Technology)
Gaze Tracking and Assistive Technology
article

Uppmärksamhetsanalys i en Mixed Reality-miljö

article en

Abstract

This thesis explores how user attention in mixed reality can be analysed by combining eye tracking with object detection. A real-time module was developed for Microsoft HoloLens 2 to capture gaze data, project fixation points onto videoframes, and check for overlaps with detected objects. In this context, “attention” is defined as the user’s visual focus point. The module streams video and gaze data to a YOLOv5 object detection server. Due to hardware constraints, the server processes around 3 frames per second, which is lower than ideal for real-time applications. A user study was conducted in a controlled environment containing both virtual and physical objects. No explicit instructions were given about task elements to avoid influencing natural attention patterns.The module detects object-gaze overlaps and records metrics like fixation duration and object distance. While performance is currently limited by processing speed, the module demonstrates a working prototype for analysing gaze behaviour in mixed reality environments.

KTH Publication Database DiVA (KTH Royal Institute of Technology)
Lunds Universitet, Malmö Högskola
Openalex Percentile: Top 46%
Gaze Tracking and Assistive Technology
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.