iCook: A Smart Tangible Cooking Interface Integrating TUIO Markers, Hand Gestures, Object Detection, Emotion Analysis, and Eye Gaze Tracking

User engagement in smart cooking classrooms is a crucial factor in enhancing the user experience and simplifying the cooking process. This study compares Tangible User Interfaces (TUI) and gesture recognition combined with object detection to assess their interactivity and usability in future cooking environments. Eleven participants (aged 18 to 22) prepared selected meal recipes using either TUI or gestures with object-based interactions. Results showed that TUI significantly reduced task completion time <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">${({\mathrm{t}}=-3.2185,\ \mathrm{p}=0.0053)}$</tex> compared to gesture However, both methods contributed to increased engagement and enjoyment of the cooking experience. Facial expression analysis enabled the evaluation of users' emotional states during cooking. The findings reveal that TUI primarily elicited positive emotions, such as happiness and surprise, whereas gesture-based interaction was more frequently associated with errors and moments of surprise. These results highlight the potential of TUI in optimizing user experience while also demonstrating the unique advantages of both interaction modalities in smart cooking: environments.

Authors

Institutions

Publication Details

Published
2025-04-16
DOI
https://doi.org/10.1109/ictcs65341.2025.10989293
Primary Topic
Gaze Tracking and Assistive Technology
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

iCook: A Smart Tangible Cooking Interface Integrating TUIO Markers, Hand Gestures, Object Detection, Emotion Analysis, and Eye Gaze Tracking

Maha Radwan, Shahzaib Ashraf, Ayman Atia
Gaze Tracking and Assistive Technology
article

iCook: A Smart Tangible Cooking Interface Integrating TUIO Markers, Hand Gestures, Object Detection, Emotion Analysis, and Eye Gaze Tracking

Maha Radwan, Shahzaib Ashraf, Ayman Atia
article en

Abstract

User engagement in smart cooking classrooms is a crucial factor in enhancing the user experience and simplifying the cooking process. This study compares Tangible User Interfaces (TUI) and gesture recognition combined with object detection to assess their interactivity and usability in future cooking environments. Eleven participants (aged 18 to 22) prepared selected meal recipes using either TUI or gestures with object-based interactions. Results showed that TUI significantly reduced task completion time <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">${({\mathrm{t}}=-3.2185,\ \mathrm{p}=0.0053)}$</tex> compared to gesture However, both methods contributed to increased engagement and enjoyment of the cooking experience. Facial expression analysis enabled the evaluation of users' emotional states during cooking. The findings reveal that TUI primarily elicited positive emotions, such as happiness and surprise, whereas gesture-based interaction was more frequently associated with errors and moments of surprise. These results highlight the potential of TUI in optimizing user experience while also demonstrating the unique advantages of both interaction modalities in smart cooking: environments.

October University of Modern Sciences and Arts (EG)
Zero hunger
Openalex Percentile: Top 90%
Gaze Tracking and Assistive Technology
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.