Translating Sentences from Written French into LSF Annotation
The automatic translation of written language into sign language can be approached as a two-stage process.In the first stage, written sentences are transcribed into gloss-based annotations that represent the structure of the target sign language; in the second, these annotations are used to generate 3D animations via a signing avatar.This paper focuses on the first stage: the automatic generation of gloss-based representations for French Sign Language (LSF) from written French.Beyond the general methodological framework, our main contributions are as follows: (i) the design of a parameterized glossed-based specification language that accurately captures the grammatical properties of LSF; and (ii) the implementation of a method for transcribing written French into gloss-based LSF annotations, using large language models trained on a limited amount of data.Our approach is evaluated using a bilingual corpus collected within the SignToKids project [27].The results are promising and demonstrate the method's potential for scaling to larger datasets.
Authors
- Clément Reverdy (ORCID: https://orcid.org/0009-0009-9686-0227)
- Sylvie Gibet (ORCID: https://orcid.org/0000-0002-3824-1542)
- Pierre-François Marteau
Institutions
- Université de Bretagne Sud (FR)
- Institut de Recherche en Informatique et Systèmes Aléatoires (FR)
Publication Details
- Published
- 2025-09-16
- DOI
- https://doi.org/10.1145/3742886.3756725
- Primary Topic
- Natural Language Processing Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Agence Nationale de la Recherche