ADIFF: Explaining audio difference using natural language
ADIFF is an audio prefix tuning-based language model with a cross-projection module and undergoes a three-step training process. ADIFF takes two audios and text prompt as input and produces different tiers of difference explanations as output. This involves identifying and describing audio events, acoustic scenes, signal characteristics, and their emotional impact on listeners. The code repository is: soham97/ADIFF
Institutions
- Microsoft (United States) (US)
- Carnegie Mellon University (US)
Publication Details
- Journal
- Zenodo (CERN European Organization for Nuclear Research)
- Published
- 2025-02-06
- DOI
- https://doi.org/10.5281/zenodo.14706089
- Primary Topic
- Music and Audio Processing
- Type
- article
- Field-Weighted Citation Impact
- 0.00