Graph Neural Network Model Under Multi-Modal Fusion

In the real world, data usually exhibits multimodal characteristics with different sources and formats. Traditional unimodal processing methods often fail to fully utilize the correlation and complementary information between different modalities. In this paper, we integrate various modal data into a graph neural network framework to effectively learn and analyze the complex relationships between nodes and edges. Through the techniques of feature fusion, decision fusion and deep fusion, multimodal data can be comprehensively analyzed to extract more meaningful insights. The experimental results show the effectiveness of the method, and the classification accuracy is significantly improved, reaching up to 98 %. The recall rate reaches 86.9% and the F1 score is 0.964. These metrics highlight the strong performance that the model shows in complex, realistic scenarios dealing with multimodal data. The model shows significant potential in handling multimodal data, providing a robust and efficient method for complex data analysis. This demonstrates that in the real world, utilizing the rich information of multimodal data can lead to deeper insights and superior performance.

Authors

Institutions

Publication Details

Published
2024-11-22
DOI
https://doi.org/10.1109/iciics63763.2024.10860124
Citations
2
Primary Topic
Advanced Computational Techniques and Applications
Type
article
Field-Weighted Citation Impact
0.69
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Graph Neural Network Model Under Multi-Modal Fusion

Tao Tao, Ruoqi Zhang, Zhuo Chen, Qingyuan Hu et al.
2 citations
Advanced Computational Techniques and Applications
0.69
article

Graph Neural Network Model Under Multi-Modal Fusion

Tao Tao, Ruoqi Zhang, Zhuo Chen, Qingyuan Hu, Zhen Li, Jibin Wang
article en
2 citations

Abstract

In the real world, data usually exhibits multimodal characteristics with different sources and formats. Traditional unimodal processing methods often fail to fully utilize the correlation and complementary information between different modalities. In this paper, we integrate various modal data into a graph neural network framework to effectively learn and analyze the complex relationships between nodes and edges. Through the techniques of feature fusion, decision fusion and deep fusion, multimodal data can be comprehensively analyzed to extract more meaningful insights. The experimental results show the effectiveness of the method, and the classification accuracy is significantly improved, reaching up to 98 %. The recall rate reaches 86.9% and the F1 score is 0.964. These metrics highlight the strong performance that the model shows in complex, realistic scenarios dealing with multimodal data. The model shows significant potential in handling multimodal data, providing a robust and efficient method for complex data analysis. This demonstrates that in the real world, utilizing the rich information of multimodal data can lead to deeper insights and superior performance.

China Mobile (China) (CN)
Openalex Percentile: Top 22%
Advanced Computational Techniques and Applications
0.69
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.