Development of a Real-Time Multi-Person 3D Keypoint Detection System Using Stereoscopic Cameras and RTMPose

The feature offers a way of tracking the movement patterns of many people at once, and is critical in occupational health, sports performance, and team-based work settings.The selected traditional biomechanical analysis systems, in turn, are largely considered in detecting single person movement, which weakens their applicability to movement analysis that involves interacting with multiple people.In this paper we consider a real time multi-person detection and analysis system using stereoscopic cameras and RTMPose, a novel high real-time pose estimation framework.RTMPose offers real time analysis of 2D key points for the individuals and this data is later augmented with depth data coming from stereoscopic imaging to give 3D skeletal data.The benefit of employing RTMPose is that the system is able to perform accurate and fast multiple persons tracking despite present occlusion scenarios.Consequently, the system overcomes the drawbacks of prior methods, including reliance on wearable devices and unsuitability for out-of-door environments, by employing stereoscopic cameras and RTMPose with low-latency and high-accurate inference.Experimental results demonstrate the system's ability to provide detailed real-time analysis of posture and movement for multiple individuals in diverse scenarios.This research highlights the potential of RTMPose-powered systems to advance multi-person biomechanical analysis for applications ranging from workplace monitoring to sports performance assessment.

Authors

Institutions

Publication Details

Journal
Proceedings of International Conference on Artificial Life and Robotics
Published
2025-02-13
DOI
https://doi.org/10.5954/icarob.2025.os21-5
Primary Topic
Video Surveillance and Tracking Methods
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Development of a Real-Time Multi-Person 3D Keypoint Detection System Using Stereoscopic Cameras and RTMPose

Praveen Gunaratne, Taufik Soesilo, Hiroki Tamura
Proceedings of International Conference on Artificial Life and Robotics
Video Surveillance and Tracking Methods
article

Development of a Real-Time Multi-Person 3D Keypoint Detection System Using Stereoscopic Cameras and RTMPose

Praveen Gunaratne, Taufik Soesilo, Hiroki Tamura
article en

Abstract

The feature offers a way of tracking the movement patterns of many people at once, and is critical in occupational health, sports performance, and team-based work settings.The selected traditional biomechanical analysis systems, in turn, are largely considered in detecting single person movement, which weakens their applicability to movement analysis that involves interacting with multiple people.In this paper we consider a real time multi-person detection and analysis system using stereoscopic cameras and RTMPose, a novel high real-time pose estimation framework.RTMPose offers real time analysis of 2D key points for the individuals and this data is later augmented with depth data coming from stereoscopic imaging to give 3D skeletal data.The benefit of employing RTMPose is that the system is able to perform accurate and fast multiple persons tracking despite present occlusion scenarios.Consequently, the system overcomes the drawbacks of prior methods, including reliance on wearable devices and unsuitability for out-of-door environments, by employing stereoscopic cameras and RTMPose with low-latency and high-accurate inference.Experimental results demonstrate the system's ability to provide detailed real-time analysis of posture and movement for multiple individuals in diverse scenarios.This research highlights the potential of RTMPose-powered systems to advance multi-person biomechanical analysis for applications ranging from workplace monitoring to sports performance assessment.

Proceedings of International Conference on Artificial Life and RoboticsVol. 30
University of Miyazaki (JP)
Openalex Percentile: Top 70%
Video Surveillance and Tracking Methods
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.