Data Fusion Approach for Unmodified UAV Tracking with Vision and mmWave Radar

The knowledge of the precise 3D position of a target in tracking applications is a fundamental requirement. The lack of a low-cost single sensor capable of providing the three-dimensional position (of a target) makes it necessary to use complementary sensors together. This research presents a Local Positioning System (LPS) for outdoor scenarios, based on a data fusion approach for unmodified UAV tracking, combining a vision sensor and mmWave radar. The proposed solution takes advantage of the radar's depth observation ability and the potential of a neural network for image processing. We have evaluated five data association approaches for radar data cluttered to get a reliable set of radar observations. The results demonstrated that the estimated target position is close to an exogenous ground truth obtained from a Visual Inertial Odometry (VIO) algorithm executed onboard the target UAV. Moreover, the developed system's architecture is prepared to be scalable, allowing the addition of other observation stations. It will increase the accuracy of the estimation and extend the actuation area. To the best of our knowledge, this is the first work that uses a mmWave radar combined with a camera and a machine learning algorithm to track a UAV in an outdoor scenario.