The Multi-Modal Robot Perception, Language Information, and Environment Prediction Model Based on Deep Learning
This paper presents a deep learning-based model to enhance robot perception and prediction in complex environments. The model utilizes CNN, LSTM, and attention mechanisms to address multimodal perception and environment prediction tasks. The introduction provides background on the importance of robots in various fields and emphasizes the need for multimodal perception. The methodology section explains the working principles of CNN, LSTM, and attention mechanisms. The experimental results demonstrate significant improvements in robot perception and prediction, with low errors and high accuracy. The proposed model supports robot applications in complex environments such as autonomous navigation and human-robot interaction. It effectively handles multimodal data and enhances robot perception and prediction capabilities. The experimental results validate the model's effectiveness, providing important support for robot decision-making in complex environments.
Authors
- Nian Xing (ORCID: https://orcid.org/0000-0002-3420-9676)
- Yiming Zhao (ORCID: https://orcid.org/0000-0001-9930-8635)
- Yangchao Cai (ORCID: https://orcid.org/0009-0000-8053-8254)
- Wenkai Zhang
Institutions
- Central University of Finance and Economics (CN)
- University of Illinois Urbana-Champaign (US)
- Sichuan International Studies University (CN)
- Zhejiang Gongshang University Hangzhou College of Commerce
- Zhejiang Gongshang University (CN)
Publication Details
- Journal
- Journal of Organizational and End User Computing
- Published
- 2024-08-05
- DOI
- https://doi.org/10.4018/joeuc.349987
- Citations
- 3
- Primary Topic
- Multimodal Machine Learning Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.75