Easy Turn: Integrating Acoustic and Linguistic Modalities for Robust Turn-Taking in Full-Duplex Spoken Dialogue Systems
Full-duplex interaction is crucial for natural human–machine communication, yet remains challenging as it requires robust turn-taking detection to decide when the system should speak, listen, or remain silent. Existing solutions either rely on dedicated turn-taking models, most of which are not open-sourced. The few vailable ones are limited by their large parameter size or by supporting only a single modality, such as acoustic or linguistic. Alternatively, some approaches finetune LLM backbones to enable full-duplex capability, but this requires large amounts of full-duplex data, which remain scarce in open-source form. To address these issues, we propose Easy Turn—an open-source, modular turn-taking detection model that integrates acoustic and linguistic bimodal information to predict four dialogue turn states: complete, incomplete, backchannel, and wait, accompanied by the release of Easy Turn trainset, a 1,145-hour speech dataset designed for training turn-taking detection models. Compared to existing open-source models like TEN Turn Detection and Smart Turn V2, our model achieves state-of-the-art turn-taking detection accuracy on our open-source Easy Turn testset. The data and model will be made publicly available on GitHub. <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sup>
Authors
- Shuiyuan Wang
- Hongfei Xue (ORCID: https://orcid.org/0000-0001-9691-9668)
- Chengyou Wang (ORCID: https://orcid.org/0000-0002-0901-2492)
- Longshuai Xiao
- Yuke Lin
- Guojian Li
- Wenjie Li (ORCID: https://orcid.org/0000-0003-2104-7986)
- Zihan Zhang (ORCID: https://orcid.org/0000-0002-0415-7721)
- Lei Xie (ORCID: https://orcid.org/0000-0001-8234-0823)
- Zhonghua Fu
Institutions
- Northwestern Polytechnical University (CN)
- Huawei Technologies (China) (CN)
Publication Details
- Published
- 2026-04-21
- DOI
- https://doi.org/10.1109/icassp55912.2026.11463929
- Primary Topic
- Speech and dialogue systems
- Type
- article
- Field-Weighted Citation Impact
- 0.00