In‐Device Topological Encoding for Intelligent Multimodal Interactions

Abstract For accurate intent recognition and differential decision making in dynamic interactive scenarios, a scenario‐adaptive interactive interface with touch features and external factor‐perceiving capability is essential. However, existing interactive interfaces based on discrete array structures are constrained by excessive data redundancy, sensing‐computing separation, and external factor insensitivity. In this study, an intelligent interactive interface for multimodal synergistic cognition (MSC), which adopts a signal linear partition strategy with spatiotemporal encoding, and innovatively enables the addressable perception and fusion of multimodal features within only one channel. Designing a heterogeneous transconductance structure, the MSC interactive interface mimics the multidimensional amplitude weighting and event‐driven logic of the biological stimulation gating mechanism, achieving multipoint and wide‐range (0.8–250 kPa) tactile decoding and external‐factor‐based intent correction in complex scenarios. Owing to cuttability and topological reconfiguration, the MSC interactive interface promotes the form generalization of interactive entities and facilitates intelligent learning (accuracy > 99%) of unstructured features. The demonstration of touch‐strain‐driven robotic arm control highlights the importance of touch cognitive alignment with external factors in non‐predefined scenes. This study promotes the transition of intelligent machines from passive response to differentiable cognition with external‐factor enhancement, providing a foundational approach to a triadic cognitive framework integrating touch, machine, and external factors.

Authors

Institutions

Publication Details

Journal
Advanced Functional Materials
Published
2025-08-21
DOI
https://doi.org/10.1002/adfm.202515750
Citations
2
Primary Topic
Tactile and Sensory Interactions
Type
article
Field-Weighted Citation Impact
2.86

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

In‐Device Topological Encoding for Intelligent Multimodal Interactions

Wansheng Lin, Qingliang Liao, Runsheng Gao, Ziquan Guo et al.
2 citations
Advanced Functional Materials
Tactile and Sensory Interactions
2.86
article

In‐Device Topological Encoding for Intelligent Multimodal Interactions

Wansheng Lin, Qingliang Liao, Runsheng Gao, Ziquan Guo, Huali Yang, Shifan Yu, Xiaojian Zhu, Huasen Wang, Jianghui Zheng, Yuxuan Hu, Lei Liu, Zhong Chen, Yuanjin Zheng, Xinqin Liao, Zijian Huang, Yanhao Luo, Xiang Xiao, Hongyu Chen
article en
2 citations

Abstract

Abstract For accurate intent recognition and differential decision making in dynamic interactive scenarios, a scenario‐adaptive interactive interface with touch features and external factor‐perceiving capability is essential. However, existing interactive interfaces based on discrete array structures are constrained by excessive data redundancy, sensing‐computing separation, and external factor insensitivity. In this study, an intelligent interactive interface for multimodal synergistic cognition (MSC), which adopts a signal linear partition strategy with spatiotemporal encoding, and innovatively enables the addressable perception and fusion of multimodal features within only one channel. Designing a heterogeneous transconductance structure, the MSC interactive interface mimics the multidimensional amplitude weighting and event‐driven logic of the biological stimulation gating mechanism, achieving multipoint and wide‐range (0.8–250 kPa) tactile decoding and external‐factor‐based intent correction in complex scenarios. Owing to cuttability and topological reconfiguration, the MSC interactive interface promotes the form generalization of interactive entities and facilitates intelligent learning (accuracy > 99%) of unstructured features. The demonstration of touch‐strain‐driven robotic arm control highlights the importance of touch cognitive alignment with external factors in non‐predefined scenes. This study promotes the transition of intelligent machines from passive response to differentiable cognition with external‐factor enhancement, providing a foundational approach to a triadic cognitive framework integrating touch, machine, and external factors.

Advanced Functional MaterialsVol. 36(8)
Nanyang Technological University (SG), Xiamen University (CN), Chinese Academy of Sciences (CN), Ningbo Institute of Industrial Technology (CN), University of Science and Technology Beijing (CN)
National Natural Science Foundation of China, National Key Research and Development Program of China
Openalex Percentile: Top 9%
Tactile and Sensory Interactions
2.86
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.