Exploring Diversity-Based Active Learning for 3D Object Detection in Autonomous Driving
3D object detection has recently received much attention due to its great potential in autonomous vehicle (AV). The success of deep learning based object detectors relies on the availability of large-scale annotated datasets, which is time-consuming and expensive to compile, especially for 3D bounding box annotation. In this work, we investigate diversity-based active learning (AL) as a potential solution to alleviate the annotation burden. Given limited annotation budget, only the most informative frames and objects are automatically selected for human to annotate. Technically, we take the advantage of the multimodal information provided in an AV dataset, and propose a novel acquisition function that enforces spatial and temporal diversity in the selected samples. We benchmark the proposed method against other AL strategies under realistic annotation cost measurements, where the realistic costs for annotating a frame and a 3D bounding box are both taken into consideration. We demonstrate the effectiveness of the proposed method on the nuScenes dataset and show that it outperforms existing AL strategies significantly.
Authors
- Shengheng Deng
- Jinpeng Lin (ORCID: https://orcid.org/0000-0002-8644-4328)
- Zhihao Liang (ORCID: https://orcid.org/0000-0003-0485-9376)
- Tao Jiang (ORCID: https://orcid.org/0000-0002-2461-1354)
- Kui Jia (ORCID: https://orcid.org/0000-0003-2661-5700)
- Tianrui Li (ORCID: https://orcid.org/0000-0001-7780-104X)
- Xun Xu (ORCID: https://orcid.org/0000-0002-5220-2240)
- Lile Cai (ORCID: https://orcid.org/0000-0001-8783-0186)
Institutions
- Agency for Science, Technology and Research (SG)
- Institute for Infocomm Research (SG)
- Chinese University of Hong Kong, Shenzhen (CN)
- Southwest Jiaotong University (CN)
- Chengdu University of Traditional Chinese Medicine (CN)
- South China University of Technology (CN)
Publication Details
- Journal
- IEEE Transactions on Intelligent Transportation Systems
- Published
- 2024-10-07
- DOI
- https://doi.org/10.1109/tits.2024.3463801
- Citations
- 16
- Primary Topic
- Advanced Manufacturing and Logistics Optimization
- Type
- article
- Field-Weighted Citation Impact
- 5.58
Funders
- National Natural Science Foundation of China