AudioSet-R: A Refined AudioSet with Multi-Stage LLM Label Reannotation
AudioSet is a widely used benchmark in the audio research community and has significantly advanced various audio-related tasks. However, persistent issues with label accuracy and completeness remain critical bottlenecks that limit performance in downstream applications. To address the aforementioned challenges, we propose a three-stage reannotation framework that harnesses general-purpose audio-language foundation models to systematically improve the label quality of AudioSet. The framework employs a cross-modal prompting strategy, inspired by the concept of prompt chaining, wherein prompts are sequentially composed to execute subtasks (audio comprehension, label synthesis, and semantic alignment). Leveraging this framework, we construct a high-quality, structured relabeled version of AudioSet-R. Extensive experiments conducted on representative audio classification models-including AST, PANNs, SSAST, and AudioMAE-consistently demonstrate substantial performance improvements, thereby validating the generalizability and effectiveness of the proposed approach in enhancing label reliability.The code is publicly available at: https://github.com/colaudiolab/AudioSet-R.
Authors
- Yi Su (ORCID: https://orcid.org/0000-0001-8794-7376)
- Kele Xu (ORCID: https://orcid.org/0000-0001-5997-5169)
- Qisheng Xu (ORCID: https://orcid.org/0000-0003-4141-5950)
- Yong Dou (ORCID: https://orcid.org/0000-0002-1256-8934)
- Qian Zhu (ORCID: https://orcid.org/0009-0001-8663-0382)
- Xinwang Liu (ORCID: https://orcid.org/0000-0001-9066-1475)
- Yining Sun (ORCID: https://orcid.org/0009-0007-7802-663X)
Institutions
- National University of Defense Technology (CN)
Publication Details
- Published
- 2025-10-25
- DOI
- https://doi.org/10.1145/3746027.3758260
- Citations
- 1
- Primary Topic
- Music and Audio Processing
- Type
- article
- Field-Weighted Citation Impact
- 1.49
Funders
- National University of Defense Technology
- National Science and Technology Major Project