ADIFF: Explaining audio difference using natural language

ADIFF is an audio prefix tuning-based language model with a cross-projection module and undergoes a three-step training process. ADIFF takes two audios and text prompt as input and produces different tiers of difference explanations as output. This involves identifying and describing audio events, acoustic scenes, signal characteristics, and their emotional impact on listeners. The code repository is: soham97/ADIFF

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2025-02-06
DOI
https://doi.org/10.5281/zenodo.14706089
Primary Topic
Music and Audio Processing
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

ADIFF: Explaining audio difference using natural language

Zenodo (CERN European Organization for Nuclear Research)
Music and Audio Processing
article

ADIFF: Explaining audio difference using natural language

article en

Abstract

ADIFF is an audio prefix tuning-based language model with a cross-projection module and undergoes a three-step training process. ADIFF takes two audios and text prompt as input and produces different tiers of difference explanations as output. This involves identifying and describing audio events, acoustic scenes, signal characteristics, and their emotional impact on listeners. The code repository is: soham97/ADIFF

Zenodo (CERN European Organization for Nuclear Research)
Microsoft (United States) (US), Carnegie Mellon University (US)
Quality Education
Openalex Percentile: Top 47%
Music and Audio Processing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

ADIFF: Explaining audio difference using natural language · Zenodo (CERN European Organization for Nuclear Research) (2025) | TGRS Research Map | TGRS