PET: High-Frequency Temporal Self-Consistency Learning for Partially Deepfake Audio Localization

Partially deepfake audio attacks have attracted the attention recently, and the demand for locating the manipulation regions of partially deepfake audio arises accordingly. However, existing methods are usually proposed based on frame-level authenticity detection or splicing boundaries detection, neglecting the temporal self-consistency of audio. In this paper, we propose a novel method for partially deepfake audio localization based on temporal self-consistency learning via high-frequency components, named as PET. The results demonstrates that, in ADD 2023 Track 2 eval set, it could achieve the segment F1-score at 0.7397 without any data augmentation strategies, which is 21.94% higher than that of the system ranked 1st on the leaderboard. It also confirms the effectiveness and well generalization ability of PET.

Authors

Institutions

Publication Details

Published
2025-03-12
DOI
https://doi.org/10.1109/icassp49660.2025.10889913
Citations
1
Primary Topic
Speech Recognition and Synthesis
Type
article
Field-Weighted Citation Impact
2.48

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

PET: High-Frequency Temporal Self-Consistency Learning for Partially Deepfake Audio Localization

Jiayi He, Jiangyan Yi, Siding Zeng, Jianhua Tao
1 citations
Speech Recognition and Synthesis
2.48
article

PET: High-Frequency Temporal Self-Consistency Learning for Partially Deepfake Audio Localization

Jiayi He, Jiangyan Yi, Siding Zeng, Jianhua Tao
article en
1 citations

Abstract

Partially deepfake audio attacks have attracted the attention recently, and the demand for locating the manipulation regions of partially deepfake audio arises accordingly. However, existing methods are usually proposed based on frame-level authenticity detection or splicing boundaries detection, neglecting the temporal self-consistency of audio. In this paper, we propose a novel method for partially deepfake audio localization based on temporal self-consistency learning via high-frequency components, named as PET. The results demonstrates that, in ADD 2023 Track 2 eval set, it could achieve the segment F1-score at 0.7397 without any data augmentation strategies, which is 21.94% higher than that of the system ranked 1st on the leaderboard. It also confirms the effectiveness and well generalization ability of PET.

Chinese Academy of Sciences (CN), Institute of Automation (CN), Tsinghua University (CN)
National Natural Science Foundation of China
Openalex Percentile: Top 11%
Speech Recognition and Synthesis
2.48
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.