Towards Computer Aided Transformation of Spoken Text to Cued Speech for Speech Therapy

The long-term goal of our interdisciplinary research is to prepare software for AR glasses to automatically convert spoken text into cued speech particles, and then, to visualize the sequence of hand positions and locations near the face according to the Cued Speech Method principles, which will accompany natural mouth movements during speaking. In the paper, we consider a problem of computer aided transformation of spoken text to cued speech. We describe formally a procedure that has to be made for transformation, and next, we show results of tests of several approaches (using large language models and a direct implementation of rules) to automatic transformations as well as expert transformations as reference.

Authors

Institutions

Publication Details

Journal
Procedia Computer Science
Published
2025-01-01
DOI
https://doi.org/10.1016/j.procs.2025.10.091
Primary Topic
Face recognition and analysis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Towards Computer Aided Transformation of Spoken Text to Cued Speech for Speech Therapy

Renata Kołodziejczyk, Aleksandra Borowicz, Piotr Kulicki, Krzysztof Pancerz et al.
Procedia Computer Science
Face recognition and analysis
article

Towards Computer Aided Transformation of Spoken Text to Cued Speech for Speech Therapy

Renata Kołodziejczyk, Aleksandra Borowicz, Piotr Kulicki, Krzysztof Pancerz, Julianna Habdank, Krystian Gułaś
article en

Abstract

The long-term goal of our interdisciplinary research is to prepare software for AR glasses to automatically convert spoken text into cued speech particles, and then, to visualize the sequence of hand positions and locations near the face according to the Cued Speech Method principles, which will accompany natural mouth movements during speaking. In the paper, we consider a problem of computer aided transformation of spoken text to cued speech. We describe formally a procedure that has to be made for transformation, and next, we show results of tests of several approaches (using large language models and a direct implementation of rules) to automatic transformations as well as expert transformations as reference.

Procedia Computer ScienceVol. 270
John Paul II Catholic University of Lublin (PL)
Openalex Percentile: Top 67%
Face recognition and analysis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.