Research on the Model of Multimodal Learning in Digital Art Education

This paper proposes a multimodal adaptive convolutional neural network (MA-CNN), which aims to improve the learning performance of complex tasks by efficiently fusing multiple modal data. The core innovation of this network lies in the introduction of an adaptive convolutional layer, which can dynamically adjust the fusion weights according to the characteristics of different modal data, thereby optimizing the feature fusion process. Furthermore, a self-supervised learning mechanism is proposed to improve the learning capability of the model without labeled data. To test the validity of MA-CNN, a large number of experiments have been carried out, and the data set contains multiple multimodal information including image, text, audio and video. The results show that the MA-CNN model is more accurate and stable than the conventional single mode model, and the precision of the model is over 15%. Experiments show that multimodal data fusion not only improves the performance of the model, but also improves the robustness of the model. The combination of adaptive convolutional layers and self-supervised learning mechanisms provides a new idea for multimodal learning. This method has shown excellent performance in complex tasks in multiple fields, has wide application potential, and provides valuable reference for future multimodal learning research.

Authors

Institutions

Publication Details

Published
2025-06-28
DOI
https://doi.org/10.1109/icipca65645.2025.11138157
Primary Topic
Digital Media and Visual Art
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Research on the Model of Multimodal Learning in Digital Art Education

Zhipeng Chen, Shiqing Wei
Digital Media and Visual Art
article

Research on the Model of Multimodal Learning in Digital Art Education

Zhipeng Chen, Shiqing Wei
article en

Abstract

This paper proposes a multimodal adaptive convolutional neural network (MA-CNN), which aims to improve the learning performance of complex tasks by efficiently fusing multiple modal data. The core innovation of this network lies in the introduction of an adaptive convolutional layer, which can dynamically adjust the fusion weights according to the characteristics of different modal data, thereby optimizing the feature fusion process. Furthermore, a self-supervised learning mechanism is proposed to improve the learning capability of the model without labeled data. To test the validity of MA-CNN, a large number of experiments have been carried out, and the data set contains multiple multimodal information including image, text, audio and video. The results show that the MA-CNN model is more accurate and stable than the conventional single mode model, and the precision of the model is over 15%. Experiments show that multimodal data fusion not only improves the performance of the model, but also improves the robustness of the model. The combination of adaptive convolutional layers and self-supervised learning mechanisms provides a new idea for multimodal learning. This method has shown excellent performance in complex tasks in multiple fields, has wide application potential, and provides valuable reference for future multimodal learning research.

Wuhan University (CN), Wuhan Institute of Bioengineering (CN)
Openalex Percentile: Top 57%
Digital Media and Visual Art
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Research on the Model of Multimodal Learning in Digital Art Education — Zhipeng Chen, Shiqing Wei · (2025) | TGRS Research Map | TGRS