Multimodal Visual Communication Effect Evaluation Method for University New Media Matrix

With the rapid rise of short video platforms and social media graphic content, the new media matrix of colleges and universities has become an important carrier for promoting educational brand communication and public interaction. However, the current influence of multimodal content in actual communication still lacks a systematic quantitative evaluation method, especially in the scenario where images, texts and user behavior information are highly integrated, and existing research is difficult to fully reflect the essential differences in communication effects. To solve this problem, this paper constructs a multimodal visual communication effect evaluation framework for the new media matrix of colleges and universities. This method combines image feature extraction (ResNet), text semantic modeling (BERT) and user behavior data, and uses a multi-layer perceptron to perform fusion modeling and communication effect scoring on multimodal information. Experimental results show that the proposed method is significantly better than the traditional single-modal model in prediction accuracy, and has good platform generalization ability and content type adaptability. Through a systematic comparative analysis of graphic and text fusion, visual-dominant and textdominant content, the key role of behavioral characteristics in the evaluation model is verified. The research results provide scientific quantitative support for the digital content operation strategy of colleges and universities, and expand the theoretical boundaries of multimodal communication effect research.

Authors

Publication Details

Published
2025-05-29
DOI
https://doi.org/10.1109/icaide65466.2025.11189570
Primary Topic
Digital Media and Visual Art
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Multimodal Visual Communication Effect Evaluation Method for University New Media Matrix

Henan Li, Shan Yu
Digital Media and Visual Art
article

Multimodal Visual Communication Effect Evaluation Method for University New Media Matrix

Henan Li, Shan Yu
article en

Abstract

With the rapid rise of short video platforms and social media graphic content, the new media matrix of colleges and universities has become an important carrier for promoting educational brand communication and public interaction. However, the current influence of multimodal content in actual communication still lacks a systematic quantitative evaluation method, especially in the scenario where images, texts and user behavior information are highly integrated, and existing research is difficult to fully reflect the essential differences in communication effects. To solve this problem, this paper constructs a multimodal visual communication effect evaluation framework for the new media matrix of colleges and universities. This method combines image feature extraction (ResNet), text semantic modeling (BERT) and user behavior data, and uses a multi-layer perceptron to perform fusion modeling and communication effect scoring on multimodal information. Experimental results show that the proposed method is significantly better than the traditional single-modal model in prediction accuracy, and has good platform generalization ability and content type adaptability. Through a systematic comparative analysis of graphic and text fusion, visual-dominant and textdominant content, the key role of behavioral characteristics in the evaluation model is verified. The research results provide scientific quantitative support for the digital content operation strategy of colleges and universities, and expand the theoretical boundaries of multimodal communication effect research.

Openalex Percentile: Top 50%
Digital Media and Visual Art
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.