Human-Robot Interactive Miniature Robot
This paper presents the development of a prototype system for human-robot interaction (HRI) utilizing gesture recognition to control a miniature robot. The research integrates advanced technologies such as MediaPipe for gesture detection, Streamlit for real-time monitoring, and Firebase for data synchronization. The system detects five gestures (forward, reverse, left, right, and stop) using index finger and whole-hand configurations, ensuring intuitive and efficient control. The system achieved recognition accuracies of (90.2%) for index finger gestures and (93.4%) for whole-hand gestures. Challenges include environmental sensitivity, hardware limitations, and response time variability. The project demonstrates potential applications in STEM education by providing an interactive learning platform. Future work includes expanding gesture sets, improving accuracy, and upgrading hardware for enhanced functionality.
Authors
- Rosdiyana Samad (ORCID: https://orcid.org/0000-0003-0508-7718)
- Nurul Hazlina Noordin (ORCID: https://orcid.org/0000-0002-5710-8368)
- Guojun Yu (ORCID: https://orcid.org/0000-0003-3932-884X)
Institutions
- Universiti Malaysia Pahang Al-Sultan Abdullah (MY)
Publication Details
- Published
- 2025-08-27
- DOI
- https://doi.org/10.1109/inecce64959.2025.11150824
- Primary Topic
- Hand Gesture Recognition Systems
- Type
- article
- Field-Weighted Citation Impact
- 0.00