Enhanced Dynamic Obstacle Avoidance for UAVs Using Event Camera and Ego-Motion Compensation

To navigate dynamic environments safely, UAVs require accurate, real time onboard perception, which relies on ego motion compensation to separate self-induced motion from external dynamics and enable reliable obstacle detection. Traditional ego-motion compensation techniques are mainly based on optimization processes and may be computationally expensive for real-time applications or lack the precision needed to handle both rotational and translational movements, leading to issues such as misidentifying static elements as dynamic obstacles and generating false positives. In this paper, we propose a novel approach that integrates an event camera-based perception pipeline with an ego-motion compensation algorithm to accurately compensate for both rotational and translational UAV motion. An enhanced warping function, integrating IMU and depth data, is constructed to compensate camera motion based on real-time IMU data to remove ego motion from the asynchronous event stream, enhancing detection accuracy by reducing false positives and missed detections. On the compensated event stream, dynamic obstacles are detected by applying a motion aware adaptive threshold to the normalized mean timestamp image, with the threshold derived from the image’s spatial mean and standard deviation and adjusted by the UAV’s angular and linear velocities. Furthermore, in conjunction with a 3D Artificial Potential Field (APF) for obstacle avoidance, the proposed approach generates smooth, collision-free paths, addressing local minima issues through a rotational force component to ensure efficient UAV navigation in dynamic environments. The effectiveness of the proposed approach is validated through simulations, and its application for UAV navigation, safety, and efficiency in environments such as warehouses is demonstrated, where real-time response and precise obstacle avoidance are essential.