Synergy of Eye and Hand: Multimodal Biomarkers for Cognitive Assessment

Traditional handwriting analysis for neurological assessment captures motor output but largely misses the guiding cognitive processes like visuospatial planning and attention. This study introduces a multimodal approach, combining online handwriting kinematics with concurrent eye-tracking data from 48 older adults performing the Pentagon Copy Test (PCT). We extracted novel feature sets, including Hand-Eye Coupling (HEC) and Fractional Derivative (FD) biomarkers, and used an XGBoost classifier with Recursive Feature Elimination (RFE) to predict a binarized PCT performance score. Our final model, integrating all features, achieved a Balanced Accuracy (BACC) of 90%, significantly outperforming a model trained on baseline features alone ($79 \%$ BACC). The findings demonstrate that integrating eye-tracking data with advanced handwriting analysis provides a powerful and holistic tool for objectively assessing cognitive-motor performance, highlighting its potential as a sensitive digital biomarker.

Authors

Institutions

Publication Details

Published
2025-11-03
DOI
https://doi.org/10.1109/icumt67815.2025.11268615
Primary Topic
Writing and Handwriting Education
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Synergy of Eye and Hand: Multimodal Biomarkers for Cognitive Assessment

Ján Mucha, Jiří Mekyska, Michal Gavenciak, Marcos Faúndez-Zanuy et al.
Writing and Handwriting Education
article

Synergy of Eye and Hand: Multimodal Biomarkers for Cognitive Assessment

Ján Mucha, Jiří Mekyska, Michal Gavenciak, Marcos Faúndez-Zanuy, Pau Ferrer-Ramos
article en

Abstract

Traditional handwriting analysis for neurological assessment captures motor output but largely misses the guiding cognitive processes like visuospatial planning and attention. This study introduces a multimodal approach, combining online handwriting kinematics with concurrent eye-tracking data from 48 older adults performing the Pentagon Copy Test (PCT). We extracted novel feature sets, including Hand-Eye Coupling (HEC) and Fractional Derivative (FD) biomarkers, and used an XGBoost classifier with Recursive Feature Elimination (RFE) to predict a binarized PCT performance score. Our final model, integrating all features, achieved a Balanced Accuracy (BACC) of 90%, significantly outperforming a model trained on baseline features alone ($79 \%$ BACC). The findings demonstrate that integrating eye-tracking data with advanced handwriting analysis provides a powerful and holistic tool for objectively assessing cognitive-motor performance, highlighting its potential as a sensitive digital biomarker.

Universitat Pompeu Fabra (ES), Brno University of Technology (CZ)
Openalex Percentile: Top 61%
Writing and Handwriting Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Synergy of Eye and Hand: Multimodal Biomarkers for Cognitive Assessment — Ján Mucha, Jiří Mekyska, et al. · (2025) | TGRS Research Map | TGRS