MINS: Efficient and Robust Multisensor‐Aided Inertial Navigation System

ABSTRACT Robust multisensor fusion of multi‐modal measurements such as inertial measurement units (IMUs), wheel encoders, cameras, LiDARs, and GPS holds great potential due to its innate ability to improve resilience to sensor failures and measurement outliers, thereby enabling robust autonomy. To the best of our knowledge, this study is among the first to develop a consistent tightly‐coupled Multisensor‐aided Inertial Navigation System (MINS) that is capable of fusing the most common navigation sensors in an efficient filtering framework, by addressing the particular challenges of computational complexity, sensor asynchronicity, and intra‐sensor calibration. In particular, we propose a consistent high‐order on‐manifold interpolation scheme to enable an efficient asynchronous sensor fusion and state management strategy (i.e., dynamic cloning). The proposed dynamic cloning leverages motion‐induced information to adaptively select interpolation orders to control computational complexity while minimizing trajectory representation errors. We perform online intrinsic and extrinsic (spatiotemporal) calibration of all onboard sensors to compensate for poor prior calibration and/or degraded calibration varying over time. Additionally, we develop an initialization method with only proprioceptive measurements of IMU and wheel encoders, instead of exteroceptive sensors, which is shown to be less affected by the environment and more robust in highly dynamic scenarios. We extensively validate the proposed MINS in simulations and large‐scale challenging real‐world datasets, outperforming the existing state‐of‐the‐art methods, in terms of localization accuracy, consistency, and computation efficiency. We have also open‐sourced our algorithm, simulator, and evaluation toolbox for the benefit of the community: https://github.com/rpng/mins .