TFS: Revisiting Temporal Language Grounding from Frequency Spiking Perspective
Temporal Language Grounding (TLG) aims to localize moments in untrimmed videos that are most relevant to natural language queries. While existing weakly-supervised methods have achieved significant success in exploring cross-modal relationships, they still face a critical bottleneck: the interference of task-irrelevant information in query embeddings. To address this issue, we propose TLG Frequency Spiking (TFS), a dimensional mask derived from the frequency domain that models the varying importance specific to different queries. By enhancing the understanding of queries, TFS effectively optimizes the cross-modal alignment of visual and textual modalities. Experimental results show that TFS significantly outperforms state-of-the-art baselines on both the Charades-STA and ActivityNet-Captions datasets.
Authors
- Yifan Lyu (ORCID: https://orcid.org/0000-0001-7314-7351)
- Lixiang Liu (ORCID: https://orcid.org/0009-0008-8713-578X)
- Hongzhou Wu (ORCID: https://orcid.org/0009-0009-5012-9666)
- Chuxiong Sun
Institutions
- National University of Defense Technology (CN)
- Chinese Academy of Sciences (CN)
- Institute of Software (CN)
- University of Chinese Academy of Sciences (CN)
Publication Details
- Published
- 2025-03-12
- DOI
- https://doi.org/10.1109/icassp49660.2025.10889584
- Primary Topic
- Speech and dialogue systems
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China
- China Postdoctoral Science Foundation