Passive Perception and Path Tracking of Tourists in Mountain Scenic Spots Through Face to Body Two Stepwise Method

Tourists’ near-field passive perception and identification in mountain areas faces challenges related to long distances, small targets, varied-pose scenarios, facial occlusion, etc. To address this issue, this paper proposes an innovative technical framework based on a face-to-body (F2B) two-step iterative method aimed at enhancing the passive perception and tracking of tourists in complex mountain environments by integrating and coordinating body features with facial features. The F2B technical framework comprises three main components: target feature acquisition, multi-feature coupled re-identification, and target positioning and tracking. Initially, the faces and bodies of tourists are extracted from real-time video streams using the RetinaFace and YOLOX models, respectively. The ArcFace model is then employed to extract the facial features of the target tourists, linking them with the faces detected by RetinaFace. Subsequently, a multi-feature database is constructed using the Hungarian algorithm to facilitate the automatic matching of the face and body of the same tourist. Finally, the Fast-ReID model and a spatial position algorithm are utilized for the re-identification of tourist targets and tracking their dynamic paths. Based on public and actual scene datasets, deployment and testing in the Yimeng Mountain Scenic Area have demonstrated that the accuracy index AP of the F2B model reaches 88.03%, with a recall of 90.28%, achieving an overall identification accuracy of approximately 90% and a false alarm rate of less than 5%. This result significantly improves the accuracy of SOTA facial recognition models in the complex environments of mountainous scenic spots. It effectively addresses the challenges associated with the low identification accuracy of non-cooperative targets in these areas through a ground video sensing network. Furthermore, it offers technical support for spatiotemporal information regarding near-field passive perception and path tracking of tourists in mountain scenic spots and showcasing broad application prospects.