A Latent Diffusion Model for Heart Sound Synthesis
There are already many analyses of heart sounds used to develop diagnostic systems for the heart condition. However, the existing heart sound database state is not sufficient to train a large number of deep learning models and is not balanced – the normal heart sounds are always more present than abnormal heart sounds. Hence, we are interested in algorithms that can generate heart sounds as they can enhance the current database state. We enter the field of large-scale modelling in medical synthesis by proposing a latent diffusion model for heart sound generation, which can generate highly realistic heart sounds. We further guide the synthesis process through text prompts and labels, revealing the research field of prompted heart sound synthesis. In terms of experimental results, our proposed method achieves good results compared to existing mathematical models. At the same time, when the generated audio is used as an unlabelled dataset in semi-supervised learning, it shows an improvement effect on the classification model. This indicates that the heart sounds generated by the diffusion model bear great value.
Authors
- Bin‐Jie Hu (ORCID: https://orcid.org/0000-0002-4716-4649)
- Björn W. Schuller (ORCID: https://orcid.org/0000-0002-6478-8699)
- Yoshiharu Yamamoto (ORCID: https://orcid.org/0000-0002-1132-0355)
- Yang Tan
- Kun Qian (ORCID: https://orcid.org/0000-0003-1666-1965)
- Qingrong Wu
- Yi Chang (ORCID: https://orcid.org/0000-0002-2417-1328)
- Haojie Zhang (ORCID: https://orcid.org/0000-0002-2209-1527)
Institutions
- Ministry of Education of the People's Republic of China (CN)
- Japan Graduate School of Education University (JP)
- Imperial College London (GB)
- The University of Tokyo (JP)
Publication Details
- Published
- 2025-03-21
- DOI
- https://doi.org/10.1109/iscait64916.2025.11010636
- Citations
- 4
- Primary Topic
- Phonocardiography and Auscultation Techniques
- Type
- article
- Field-Weighted Citation Impact
- 6.07
Funders
- Ministry of Science and Technology
- National Natural Science Foundation of China
- Beijing Institute of Technology
- Japan Society for the Promotion of Science
- Beijing Municipal Natural Science Foundation