Robots That Talk Too Much and Don't Listen Enough
Until recently, the biggest obstacles to natural spoken interaction with social robots were speech recognition errors and turn-taking failures. Advances in speech recognition have enabled much better spoken interaction, but turn-taking failures and other misunderstandings continue to be far too prevalent. This short paper looks back at earlier methods for improving speech recognition and turn-taking in interaction with social robots, and then looks at what can be done today, arguing that multimodal bidirectional streaming is needed to reduce the frequency of turn-taking failures.
Authors
- Kristiina Jokinen (ORCID: https://orcid.org/0000-0003-1229-239X)
- Graham Wilcock (ORCID: https://orcid.org/0000-0002-8407-137X)
Publication Details
- Journal
- arXiv (Cornell University)
- Published
- 2026-11-12
- DOI
- https://doi.org/10.48550/arxiv.2611.16473
- Primary Topic
- Speech and dialogue systems
- Type
- preprint