Generalization Between Signers in the Automatic Recognition of Mexican Sign Language: Measuring the Gap Between Evaluation Protocols

Mexican Sign Language (LSM) lacks large-scale corpora, and its recognition studies rarely state whether test signers appear in training. On a single LSM corpus, we measure the gap between random clip partitioning and signer-independent evaluation. Signs are represented by anatomically normalized MediaPipe keypoints and classified with a Transformer encoder. On 1664 clips of 22 signs from five identified signers, we evaluated seven architectures and nine ablations under leave-one-signer-out rotation, with ten seeds per configuration. The Transformer reached 96.1% under random partitioning but 31.5–81.9% on held-out signers, a mean gap of 32.9 percentage points (pp; 95% confidence interval 30.4–35.5). A corpus audit linked the failure on the least favorable signer to an inconsistent assignment of the dominant hand to MediaPipe’s handedness channels; a label-free canonicalization raised mean signer-independent accuracy by 5.6 pp (gap: 25.7 pp). Random partitioning compressed the differences between architectures. Permuting frame order did not reduce accuracy, and, with the number of training clips fixed, training on three of the corpus signers instead of one improved accuracy by 16.9 pp. In this corpus, the diversity of signers and of their recording conditions limits generalization more than the choice of architecture.

Authors

Institutions

Publication Details

Journal
Applied Sciences
Published
2026-11-13
DOI
https://doi.org/10.3390/app162211248
Primary Topic
Hand Gesture Recognition Systems
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Generalization Between Signers in the Automatic Recognition of Mexican Sign Language: Measuring the Gap Between Evaluation Protocols

Auria Lucia Jiménez-Gutiérrez, Luis Javier López Reyes, Rafael Becerra-Aguayo, Moisés Humberto Moya-Macías
2 links
Applied Sciences
Hand Gesture Recognition Systems
article

Generalization Between Signers in the Automatic Recognition of Mexican Sign Language: Measuring the Gap Between Evaluation Protocols

Auria Lucia Jiménez-Gutiérrez, Luis Javier López Reyes, Rafael Becerra-Aguayo, Moisés Humberto Moya-Macías
article en

Abstract

Mexican Sign Language (LSM) lacks large-scale corpora, and its recognition studies rarely state whether test signers appear in training. On a single LSM corpus, we measure the gap between random clip partitioning and signer-independent evaluation. Signs are represented by anatomically normalized MediaPipe keypoints and classified with a Transformer encoder. On 1664 clips of 22 signs from five identified signers, we evaluated seven architectures and nine ablations under leave-one-signer-out rotation, with ten seeds per configuration. The Transformer reached 96.1% under random partitioning but 31.5–81.9% on held-out signers, a mean gap of 32.9 percentage points (pp; 95% confidence interval 30.4–35.5). A corpus audit linked the failure on the least favorable signer to an inconsistent assignment of the dominant hand to MediaPipe’s handedness channels; a label-free canonicalization raised mean signer-independent accuracy by 5.6 pp (gap: 25.7 pp). Random partitioning compressed the differences between architectures. Permuting frame order did not reduce accuracy, and, with the number of training clips fixed, training on three of the corpus signers instead of one improved accuracy by 16.9 pp. In this corpus, the diversity of signers and of their recording conditions limits generalization more than the choice of architecture.

Applied SciencesVol. 16(22)
Universidad de Guadalajara (MX)
Universidad de Guadalajara
Hand Gesture Recognition Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon