Perception and sharing optimization mechanism of digital media art interactive device driven by adaptive AI

Current digital media art interactive devices are difficult to adapt to complex environments due to fixed perception mechanisms, and are easily affected by noise interference and low light, resulting in reduced recognition accuracy and interaction delay, affecting the immersive experience. This study constructs a perception and sharing optimization mechanism for digital media art interactive devices driven by adaptive Artificial Intelligence (AI). A multi-channel data fusion perception network is proposed, and the Transformer encoder is used to fuse Red-Green-Blue (RGB) image, infrared depth map, and speech spectrum map features to improve perception robustness. A user behavior temporal modeling module based on Bidirectional Graph Recurrent Transformer (Bi-GRT) is designed to achieve dynamic recognition of continuous actions, gestures, and speech emotions. Environmental simulation and adaptive control mechanisms are applied, and reinforcement learning is combined to dynamically adjust sensor parameters to adapt to environmental changes. A multi-user interactive sharing framework is constructed through federated learning to ensure privacy while improving model consistency. Finally, a real-time feedback optimization and content rendering collaborative engine is developed to achieve dynamic scheduling and optimization of multi-dimensional output content based on Graph Attention Network (Bi-GRT). Experiments show that the system has an accuracy rate of over 80% in multi-action sample recognition; the environmental adaptability achieves a response delay of 210 ms in a noisy environment; the sequence similarity of each terminal in federated learning is above 0.91; the user immersion peak is 9.2 points, Compared with existing systems, this framework has achieved breakthrough progress in environmental adaptability, multi-user collaboration, and privacy protection, providing a quantifiable performance improvement path for digital media art interactive devices.

Authors

Institutions

Publication Details

Journal
International Journal for Simulation and Multidisciplinary Design Optimization
Published
2025-01-01
DOI
https://doi.org/10.1051/smdo/2025017
Primary Topic
Virtual Reality Applications and Impacts
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Perception and sharing optimization mechanism of digital media art interactive device driven by adaptive AI

Cong Liu
International Journal for Simulation and Multidisciplinary Design Optimization
Virtual Reality Applications and Impacts
article

Perception and sharing optimization mechanism of digital media art interactive device driven by adaptive AI

Cong Liu
article en

Abstract

Current digital media art interactive devices are difficult to adapt to complex environments due to fixed perception mechanisms, and are easily affected by noise interference and low light, resulting in reduced recognition accuracy and interaction delay, affecting the immersive experience. This study constructs a perception and sharing optimization mechanism for digital media art interactive devices driven by adaptive Artificial Intelligence (AI). A multi-channel data fusion perception network is proposed, and the Transformer encoder is used to fuse Red-Green-Blue (RGB) image, infrared depth map, and speech spectrum map features to improve perception robustness. A user behavior temporal modeling module based on Bidirectional Graph Recurrent Transformer (Bi-GRT) is designed to achieve dynamic recognition of continuous actions, gestures, and speech emotions. Environmental simulation and adaptive control mechanisms are applied, and reinforcement learning is combined to dynamically adjust sensor parameters to adapt to environmental changes. A multi-user interactive sharing framework is constructed through federated learning to ensure privacy while improving model consistency. Finally, a real-time feedback optimization and content rendering collaborative engine is developed to achieve dynamic scheduling and optimization of multi-dimensional output content based on Graph Attention Network (Bi-GRT). Experiments show that the system has an accuracy rate of over 80% in multi-action sample recognition; the environmental adaptability achieves a response delay of 210 ms in a noisy environment; the sequence similarity of each terminal in federated learning is above 0.91; the user immersion peak is 9.2 points, Compared with existing systems, this framework has achieved breakthrough progress in environmental adaptability, multi-user collaboration, and privacy protection, providing a quantifiable performance improvement path for digital media art interactive devices.

International Journal for Simulation and Multidisciplinary Design OptimizationVol. 16
Shanxi University (CN), Taiyuan University of Science and Technology (CN), Taiyuan University of Technology (CN)
Openalex Percentile: Top 73%
Virtual Reality Applications and Impacts
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.