In‐Device Topological Encoding for Intelligent Multimodal Interactions
Abstract For accurate intent recognition and differential decision making in dynamic interactive scenarios, a scenario‐adaptive interactive interface with touch features and external factor‐perceiving capability is essential. However, existing interactive interfaces based on discrete array structures are constrained by excessive data redundancy, sensing‐computing separation, and external factor insensitivity. In this study, an intelligent interactive interface for multimodal synergistic cognition (MSC), which adopts a signal linear partition strategy with spatiotemporal encoding, and innovatively enables the addressable perception and fusion of multimodal features within only one channel. Designing a heterogeneous transconductance structure, the MSC interactive interface mimics the multidimensional amplitude weighting and event‐driven logic of the biological stimulation gating mechanism, achieving multipoint and wide‐range (0.8–250 kPa) tactile decoding and external‐factor‐based intent correction in complex scenarios. Owing to cuttability and topological reconfiguration, the MSC interactive interface promotes the form generalization of interactive entities and facilitates intelligent learning (accuracy > 99%) of unstructured features. The demonstration of touch‐strain‐driven robotic arm control highlights the importance of touch cognitive alignment with external factors in non‐predefined scenes. This study promotes the transition of intelligent machines from passive response to differentiable cognition with external‐factor enhancement, providing a foundational approach to a triadic cognitive framework integrating touch, machine, and external factors.
Authors
- Wansheng Lin
- Qingliang Liao (ORCID: https://orcid.org/0000-0003-4674-7540)
- Runsheng Gao (ORCID: https://orcid.org/0000-0002-4682-0413)
- Ziquan Guo (ORCID: https://orcid.org/0000-0001-9862-1670)
- Huali Yang (ORCID: https://orcid.org/0000-0002-4889-2410)
- Shifan Yu (ORCID: https://orcid.org/0000-0002-7917-6214)
- Xiaojian Zhu (ORCID: https://orcid.org/0000-0002-7188-7257)
- Huasen Wang (ORCID: https://orcid.org/0000-0002-7327-282X)
- Jianghui Zheng (ORCID: https://orcid.org/0000-0001-5123-7364)
- Yuxuan Hu (ORCID: https://orcid.org/0000-0001-5196-5409)
- Lei Liu (ORCID: https://orcid.org/0000-0001-6202-9966)
- Zhong Chen (ORCID: https://orcid.org/0000-0001-7518-1414)
- Yuanjin Zheng (ORCID: https://orcid.org/0000-0001-5791-088X)
- Xinqin Liao (ORCID: https://orcid.org/0000-0001-7772-3280)
- Zijian Huang
- Yanhao Luo
- Xiang Xiao (ORCID: https://orcid.org/0000-0003-4053-1706)
- Hongyu Chen (ORCID: https://orcid.org/0000-0002-5325-9249)
Institutions
- Nanyang Technological University (SG)
- Xiamen University (CN)
- Chinese Academy of Sciences (CN)
- Ningbo Institute of Industrial Technology (CN)
- University of Science and Technology Beijing (CN)
Publication Details
- Journal
- Advanced Functional Materials
- Published
- 2025-08-21
- DOI
- https://doi.org/10.1002/adfm.202515750
- Citations
- 2
- Primary Topic
- Tactile and Sensory Interactions
- Type
- article
- Field-Weighted Citation Impact
- 2.86
Funders
- National Natural Science Foundation of China
- National Key Research and Development Program of China