Towards Computer Aided Transformation of Spoken Text to Cued Speech for Speech Therapy
The long-term goal of our interdisciplinary research is to prepare software for AR glasses to automatically convert spoken text into cued speech particles, and then, to visualize the sequence of hand positions and locations near the face according to the Cued Speech Method principles, which will accompany natural mouth movements during speaking. In the paper, we consider a problem of computer aided transformation of spoken text to cued speech. We describe formally a procedure that has to be made for transformation, and next, we show results of tests of several approaches (using large language models and a direct implementation of rules) to automatic transformations as well as expert transformations as reference.
Authors
- Renata Kołodziejczyk (ORCID: https://orcid.org/0000-0001-7770-3220)
- Aleksandra Borowicz (ORCID: https://orcid.org/0000-0001-6183-7902)
- Piotr Kulicki (ORCID: https://orcid.org/0000-0001-5413-3886)
- Krzysztof Pancerz (ORCID: https://orcid.org/0000-0002-5452-6310)
- Julianna Habdank
- Krystian Gułaś
Institutions
- John Paul II Catholic University of Lublin (PL)
Publication Details
- Journal
- Procedia Computer Science
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1016/j.procs.2025.10.091
- Primary Topic
- Face recognition and analysis
- Type
- article
- Field-Weighted Citation Impact
- 0.00