iCook: A Smart Tangible Cooking Interface Integrating TUIO Markers, Hand Gestures, Object Detection, Emotion Analysis, and Eye Gaze Tracking
User engagement in smart cooking classrooms is a crucial factor in enhancing the user experience and simplifying the cooking process. This study compares Tangible User Interfaces (TUI) and gesture recognition combined with object detection to assess their interactivity and usability in future cooking environments. Eleven participants (aged 18 to 22) prepared selected meal recipes using either TUI or gestures with object-based interactions. Results showed that TUI significantly reduced task completion time <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">${({\mathrm{t}}=-3.2185,\ \mathrm{p}=0.0053)}$</tex> compared to gesture However, both methods contributed to increased engagement and enjoyment of the cooking experience. Facial expression analysis enabled the evaluation of users' emotional states during cooking. The findings reveal that TUI primarily elicited positive emotions, such as happiness and surprise, whereas gesture-based interaction was more frequently associated with errors and moments of surprise. These results highlight the potential of TUI in optimizing user experience while also demonstrating the unique advantages of both interaction modalities in smart cooking: environments.
Authors
- Maha Radwan (ORCID: https://orcid.org/0000-0001-7623-1110)
- Shahzaib Ashraf (ORCID: https://orcid.org/0000-0002-8616-8829)
- Ayman Atia (ORCID: https://orcid.org/0000-0003-4998-5624)
Institutions
- October University of Modern Sciences and Arts (EG)
Publication Details
- Published
- 2025-04-16
- DOI
- https://doi.org/10.1109/ictcs65341.2025.10989293
- Primary Topic
- Gaze Tracking and Assistive Technology
- Type
- article
- Field-Weighted Citation Impact
- 0.00