QG-DETR: Query-Guided Detection Transformer for Audio Moment Retrieval

Audio Moment Retrieval (AMR) has garnered increasing attention due to the rising demand for efficient audio content understanding. AMR aims to accurately locate temporal intervals in untrimmed audio based on natural language queries. However, existing approaches often struggle with cross-modal alignment, primarily because they fuse textual queries with audio representations containing irrelevant content, thereby impairing retrieval accuracy. To address this, we introduce Query-Guided DETR (QG-DETR), a novel AMR framework incorporating two critical components: a Query-Guided Audio Enhancement Module, which leverages textual queries to refine audio representations by suppressing irrelevant information, and a Cross-modal Alignment Module, explicitly designed to fuse refined audio features and textual representations to ensure accurate localization of relevant audio moments. Extensive experiments conducted on benchmark datasets including Clotho-Moment, UnAV-100, and TUT Sound Events 2017 demonstrate that our QG-DETR achieves state-of-the-art performance.

Authors

Institutions

Publication Details

Published
2025-03-21
DOI
https://doi.org/10.1109/icaace65325.2025.11020499
Primary Topic
Music and Audio Processing
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

QG-DETR: Query-Guided Detection Transformer for Audio Moment Retrieval

Zhaohui Zhang, Peng Wang, Chengde Han
Music and Audio Processing
article

QG-DETR: Query-Guided Detection Transformer for Audio Moment Retrieval

Zhaohui Zhang, Peng Wang, Chengde Han
article en

Abstract

Audio Moment Retrieval (AMR) has garnered increasing attention due to the rising demand for efficient audio content understanding. AMR aims to accurately locate temporal intervals in untrimmed audio based on natural language queries. However, existing approaches often struggle with cross-modal alignment, primarily because they fuse textual queries with audio representations containing irrelevant content, thereby impairing retrieval accuracy. To address this, we introduce Query-Guided DETR (QG-DETR), a novel AMR framework incorporating two critical components: a Query-Guided Audio Enhancement Module, which leverages textual queries to refine audio representations by suppressing irrelevant information, and a Cross-modal Alignment Module, explicitly designed to fuse refined audio features and textual representations to ensure accurate localization of relevant audio moments. Extensive experiments conducted on benchmark datasets including Clotho-Moment, UnAV-100, and TUT Sound Events 2017 demonstrate that our QG-DETR achieves state-of-the-art performance.

Hong Kong Baptist University (HK), Qinghai University Affiliated Hospital (CN)
Openalex Percentile: Top 85%
Music and Audio Processing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.