Ability adaptive AAC: toward a modular, open-source framework
Technological advances in high-tech Augmentative and Alternative Communication (AAC) have expanded access for many individuals with complex communication needs; however, people with profound motor or cognitive impairments often remain underserved. Embodied communication is an essential component of human interaction, and prior research has demonstrated that individualized movements, postures, and vocalizations can be modeled computationally as communicative signals. Yet commercially available high-tech AAC systems generally treat embodied actions as mechanisms for accessing symbol-based interfaces rather than as communicative expressions in their own right. This design-oriented research note presents A3CP (Ability-Adaptive Augmentative Communication Platform), a modular AAC architecture for interpreting individualized, embodied communication through user-specific machine learning and communication partner clarification. An initial feasibility prototype was used to explore workflows for capturing and labeling embodied, communicative behaviors and training user-specific machine learning models. Findings from this exploratory work informed an architectural framework for coordinating multimodal input, uncertainty handling, communication partner clarification, and longitudinal user-specific model adaptation. Claims are limited to architectural specification and technical feasibility. This work provides an architectural foundation for future co-design and empirical investigation of AAC systems that can learn individualized, embodied communication.
Authors
- Asmail Muftah (ORCID: https://orcid.org/0000-0003-4174-8595)
- Dmitri Katz (ORCID: https://orcid.org/0000-0003-1345-7539)
- Andrea Zisman (ORCID: https://orcid.org/0000-0002-7459-3967)
- Mohamed Bennasar (ORCID: https://orcid.org/0000-0001-8308-1632)
- Anthony Johnston (ORCID: https://orcid.org/0009-0009-6778-5539)
- Anas Muhammad (ORCID: https://orcid.org/0009-0008-3411-0407)
Institutions
- The Open University (GB)
Publication Details
- Journal
- Augmentative and Alternative Communication
- Published
- 2026-09-15
- DOI
- https://doi.org/10.1080/07434618.2026.2716643
- Primary Topic
- Assistive Technology in Communication and Mobility
- Type
- article
- Field-Weighted Citation Impact
- 0.00