SASDN: A Generalizable and Minimal-Intervention LLM-Integrated Framework for Continual Adaptation in Spoofed Speech Detection

The rapid rise of generative AI (Gen-AI) technologies has escalated spoofing risks for automatic speaker verification (ASV) systems. Tra- ditional acoustic-only methods often fail when faced with unseen or sophisticated attacks. We propose the Semantic-Aided Spoofing Detection Network (SASDN), which augments RawNet2 with large language model (LLM) support at inference time via a two-step mechanism: (1) a learned embedding space formed during training, and (2) final score fusion weighted by a tunable factor δ. Rather than relying on complex multi-modal training pipelines, SASDN incorporates a novel label impurity strategy that conditions the model to accept uncertain supervision by substituting a fraction of ground truth labels with ''Don't Know.'' At inference, the LLM evaluates transcribed speech against external knowledge to verify authenticity and adjusts the ASV model's prediction accordingly. If the LLM is uncertain, SASDN reverts to the original acoustic classification, ensuring no performance degradation. Evaluations on a VoxCeleb2-derived spoofed dataset demonstrate that SASDN reduces the equal error rate (EER) from 22.71% to 6.5%, offering a continually adaptive defense against emerging threats.

Authors

Institutions

Publication Details

Published
2025-10-08
DOI
https://doi.org/10.1145/3746265.3759675
Primary Topic
Speech Recognition and Synthesis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

SASDN: A Generalizable and Minimal-Intervention LLM-Integrated Framework for Continual Adaptation in Spoofed Speech Detection

Rajiv Ratn Shah, Nabeel Koya A, Akash Kushwaha, Utkarsh Venaik
Speech Recognition and Synthesis
article

SASDN: A Generalizable and Minimal-Intervention LLM-Integrated Framework for Continual Adaptation in Spoofed Speech Detection

Rajiv Ratn Shah, Nabeel Koya A, Akash Kushwaha, Utkarsh Venaik
article en

Abstract

The rapid rise of generative AI (Gen-AI) technologies has escalated spoofing risks for automatic speaker verification (ASV) systems. Tra- ditional acoustic-only methods often fail when faced with unseen or sophisticated attacks. We propose the Semantic-Aided Spoofing Detection Network (SASDN), which augments RawNet2 with large language model (LLM) support at inference time via a two-step mechanism: (1) a learned embedding space formed during training, and (2) final score fusion weighted by a tunable factor δ. Rather than relying on complex multi-modal training pipelines, SASDN incorporates a novel label impurity strategy that conditions the model to accept uncertain supervision by substituting a fraction of ground truth labels with ''Don't Know.'' At inference, the LLM evaluates transcribed speech against external knowledge to verify authenticity and adjusts the ASV model's prediction accordingly. If the LLM is uncertain, SASDN reverts to the original acoustic classification, ensuring no performance degradation. Evaluations on a VoxCeleb2-derived spoofed dataset demonstrate that SASDN reduces the equal error rate (EER) from 22.71% to 6.5%, offering a continually adaptive defense against emerging threats.

Indraprastha Institute of Information Technology Delhi (IN), Centre for Development of Advanced Computing (IN), Indian Institute of Technology Delhi (IN)
Openalex Percentile: Top 85%
Speech Recognition and Synthesis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.