Research on Multimodal Data Fusion and Analysis Methods Driven by Knowledge Graph

In this paper, a new Depth Mixed-RESnet (DM-RN) model is proposed through multi-mode fusion, which aims to organically integrate the logic of depth-first search (DFS) algorithm, the residual learning advantage of ResNet and the Mixed attention (MA) mechanism, so as to promote the research of multi-modal data fusion and analysis methods driven by knowledge graph. The DM-RN model optimizes the depth traversal of the network structure by DFS strategy to ensure the effective transmission of information. Combined with ResNet residual connection, the problem of gradient disappearance in deep network training can be effectively alleviated and the representation ability of the model can be improved. Mixed attention mechanism is introduced to enhance the ability of the model to capture key information in multi-modal data. Finally, by comparing with traditional multi-module data, the experimental results show that DM-RN method has significant advantages in improving the accuracy of multi-mode data fusion and analysis and accelerating the loss function. This method can not only integrate heterogeneous data from multiple sources efficiently, but also improve the analysis accuracy and generalization performance.

Authors

Institutions

Publication Details

Published
2024-11-22
DOI
https://doi.org/10.1109/icdsca63855.2024.10859319
Citations
1
Primary Topic
Advanced Computational Techniques and Applications
Type
article
Field-Weighted Citation Impact
0.35
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Research on Multimodal Data Fusion and Analysis Methods Driven by Knowledge Graph

Yanan Liu, Lidong Sun, Wenshuo Zhang
1 citations
Advanced Computational Techniques and Applications
0.35
article

Research on Multimodal Data Fusion and Analysis Methods Driven by Knowledge Graph

Yanan Liu, Lidong Sun, Wenshuo Zhang
article en
1 citations

Abstract

In this paper, a new Depth Mixed-RESnet (DM-RN) model is proposed through multi-mode fusion, which aims to organically integrate the logic of depth-first search (DFS) algorithm, the residual learning advantage of ResNet and the Mixed attention (MA) mechanism, so as to promote the research of multi-modal data fusion and analysis methods driven by knowledge graph. The DM-RN model optimizes the depth traversal of the network structure by DFS strategy to ensure the effective transmission of information. Combined with ResNet residual connection, the problem of gradient disappearance in deep network training can be effectively alleviated and the representation ability of the model can be improved. Mixed attention mechanism is introduced to enhance the ability of the model to capture key information in multi-modal data. Finally, by comparing with traditional multi-module data, the experimental results show that DM-RN method has significant advantages in improving the accuracy of multi-mode data fusion and analysis and accelerating the loss function. This method can not only integrate heterogeneous data from multiple sources efficiently, but also improve the analysis accuracy and generalization performance.

Shandong University (CN)
Openalex Percentile: Top 29%
Advanced Computational Techniques and Applications
0.35
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.