Akshar Mitra: a multimodal integrated framework for early dyslexia detection
Developmental dyslexia is a prevalent neurobiological disorder affecting 10%-15% of children globally, yet it remains largely undiagnosed due to the inaccessibility of conventional assessments in resource-limited settings. Existing screening methods are further constrained by their reliance on unimodal data streams and the need for large, clinically-labeled datasets. This paper presents Akshar Mitra, a Multimodal Integrated Framework (MMF), a novel computational methodology designed for accessible and early dyslexia screening. The framework pioneers the integration of three low-cost, high-yield digital biomarkers derived from eye-tracking, speech, and handwriting analysis.The MMF is implemented through three modules: webcam-based eye-tracking for fixation and saccadic analysis, automated speech assessment for fluency metrics, and optical character recognition for handwriting error detection. Each module extracts 4-6 interpretable features (e.g., fixation regressions, word-error rate, character reversals) that are standardized via a shared data schema. These objective measures are augmented by a concise behavioral questionnaire to generate a holistic risk profile. Beyond screening, the system incorporates support tools, including a dyslexia-friendly reading interface with syllable-level highlighting, to foster user engagement and confidence.By creating a scalable, language-agnostic, and explainable system, this work offers a viable pathway to bridge the global dyslexia diagnostic gap. The MMF provides a transformative tool for proactive screening, facilitating early intervention and improving educational outcomes.
Authors
- Ravi Sahu
- Muhammad Awais (ORCID: https://orcid.org/0000-0001-7064-6796)
- Vibha Tiwari (ORCID: https://orcid.org/0000-0002-9772-4392)
- Hemant Ghayvat (ORCID: https://orcid.org/0000-0002-2487-0866)
- Rebakah Geddam (ORCID: https://orcid.org/0000-0002-5466-2048)
- Manya Sharma
- Ocean Agarwal
- Radhika Babar
Institutions
- Memorial Sloan Kettering Cancer Center (US)
- ITM University (IN)
- Linnaeus University (SE)
- Gujarat Institute of Development Research (IN)
Publication Details
- Journal
- Frontiers in Digital Health
- Published
- 2025-11-28
- DOI
- https://doi.org/10.3389/fdgth.2025.1726307
- Primary Topic
- Reading and Literacy Development
- Type
- article
- Field-Weighted Citation Impact
- 0.00