Real-Time Monophonic Dual-Pitch Extraction Model
Pitch estimation is a fundamental aspect of audio signal processing with applications in music information retrieval (MIR), speech analysis and more. This paper proposes a new model for real-time dual-pitch estimation to tackle the problem of estimating two pitches at the same time in duet songs. The model is designed for real-time processing, frame by frame and with streamlined components for efficiency. We also propose data augmentation methods for simulating duet singing scenarios. Our model is robust in single and dual-pitch scenarios through experiments with various datasets and metrics. Our results contribute to the pitch estimation techniques and provide a practical solution for real-time audio processing in MIR, speech analysis and beyond.
Authors
- Yan Chu (ORCID: https://orcid.org/0000-0002-7866-0821)
- Nhan-Ai Tran
- Yih-Liang Shen (ORCID: https://orcid.org/0000-0003-4789-6695)
- Ping-Hsuan Hsieh (ORCID: https://orcid.org/0000-0003-4244-3558)
- Tai-Shi Chi
Institutions
- National Yang Ming Chiao Tung University (TW)
- Realtek (Taiwan) (TW)
Publication Details
- Published
- 2024-12-03
- DOI
- https://doi.org/10.1109/apsipaasc63619.2025.10848971
- Primary Topic
- Music and Audio Processing
- Type
- article
- Field-Weighted Citation Impact
- 0.00