Intelligent Dietary Nutritional Analysis Robot Perception System Based on AI Stereo Vision
In the era of intelligent health management, AI-powered robotics are reshaping the landscape of nutritional monitoring. This study presents HealthMesh, an AI-integrated dietary analysis system designed for mobile devices. Leveraging deep learning and 3D vision, HealthMesh enables users to capture multi-angle food images through smartphones, which are processed in real-time via cloud infrastructure. The system employs YOLOv8 for high-precision food item detection and DUSt3R for dense 3D reconstruction, facilitating accurate volume estimation under real-world conditions. By mapping volumetric and compositional data to a comprehensive nutrition database, the system automatically calculates caloric and nutrient content-including proteins, carbohydrates, fats, vitamins, and minerals. HealthMesh generates real-time nutritional reports and visual summaries, promoting user awareness and decision-making. Through stereo vision and robotic perception algorithms, the platform offers an autonomous and scalable solution for intelligent nutrition tracking, applicable in personal. This work exemplifies the integration of AI-driven robotic perception, real-time processing, and mobile deployment, advancing the capabilities of health-focused automation systems
Authors
- Cheng‐En Wu (ORCID: https://orcid.org/0000-0002-3732-0759)
- Yu‐Ju Chen (ORCID: https://orcid.org/0000-0002-3178-6697)
- Sheng-Hsien Hsieh (ORCID: https://orcid.org/0009-0004-1255-4163)
- Ming‐Yi Lin (ORCID: https://orcid.org/0000-0001-7264-0902)
- Hui Peng (ORCID: https://orcid.org/0000-0002-9794-9225)
- Lin Wu
- Rung-Bin Lin
Institutions
- National Yunlin University of Science and Technology (TW)
- Yuan Ze University (TW)
Publication Details
- Published
- 2025-06-27
- DOI
- https://doi.org/10.1109/icras65818.2025.11108917
- Primary Topic
- Remote Sensing and Land Use
- Type
- article
- Field-Weighted Citation Impact
- 0.00