The attention mechanism for intelligent text generation of traditional cultural symbols in artistic design

Amid the digital wave, how to leverage artificial intelligence technologies to accurately interpret and reconstruct traditional cultural symbols has become a key issue in the field of artistic design. Existing image caption generation methods can identify the visual features of objects. But they often fail to capture the inherent cultural spirit and symbolic meanings when dealing with cultural symbols with profound historical connotations and abstract metaphors. This results in generated texts that remain at the level of superficial visual descriptions, lacking cultural depth. In response to this semantic gap, this study proposes an intelligent text generation model integrated with a cross-modal attention mechanism. The model constructs a dual-stream encoding architecture based on the Visual Geometry Group 19 (VGG19) and Bidirectional Encoder Representations from Transformers (BERT). By introducing multi-head self-attention and cross-modal attention modules, it achieves dynamic alignment between visual regions and cultural semantics. Different from traditional methods, the model can actively retrieve key visual clues from images according to the generated textual context. It accurately describes the physical forms of symbols and effectively interprets the cultural implications behind them. Experimental results show that this model achieves scores of 0.42 and 1.31 on the Bilingual Evaluation Understudy-4 (BLEU-4) and Consensus-based Image Description Evaluation (CIDEr) metrics, respectively, significantly outperforming benchmark models. It provides a new paradigm with both accuracy and cultural expressiveness for the digital inheritance and innovative design of traditional cultural symbols. • Present a cultural symbol text generation model based on multimodal fusion and attention mechanisms. • Employ a cross-modal attention mechanism, enabling the generated text to leverage the visual features of images and the semantic features of text. • Link the specific visual information of images with the cultural context of the text, resulting in text that is both richer and more precise in conveying visual details and cultural symbolism

Authors

Institutions

Publication Details

Journal
Applied Soft Computing
Published
2026-02-04
DOI
https://doi.org/10.1016/j.asoc.2026.114733
Primary Topic
Multimodal Machine Learning Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

The attention mechanism for intelligent text generation of traditional cultural symbols in artistic design

Xi Xu, D. Z. Guo
Applied Soft Computing
Multimodal Machine Learning Applications
article

The attention mechanism for intelligent text generation of traditional cultural symbols in artistic design

Xi Xu, D. Z. Guo
article en

Abstract

Amid the digital wave, how to leverage artificial intelligence technologies to accurately interpret and reconstruct traditional cultural symbols has become a key issue in the field of artistic design. Existing image caption generation methods can identify the visual features of objects. But they often fail to capture the inherent cultural spirit and symbolic meanings when dealing with cultural symbols with profound historical connotations and abstract metaphors. This results in generated texts that remain at the level of superficial visual descriptions, lacking cultural depth. In response to this semantic gap, this study proposes an intelligent text generation model integrated with a cross-modal attention mechanism. The model constructs a dual-stream encoding architecture based on the Visual Geometry Group 19 (VGG19) and Bidirectional Encoder Representations from Transformers (BERT). By introducing multi-head self-attention and cross-modal attention modules, it achieves dynamic alignment between visual regions and cultural semantics. Different from traditional methods, the model can actively retrieve key visual clues from images according to the generated textual context. It accurately describes the physical forms of symbols and effectively interprets the cultural implications behind them. Experimental results show that this model achieves scores of 0.42 and 1.31 on the Bilingual Evaluation Understudy-4 (BLEU-4) and Consensus-based Image Description Evaluation (CIDEr) metrics, respectively, significantly outperforming benchmark models. It provides a new paradigm with both accuracy and cultural expressiveness for the digital inheritance and innovative design of traditional cultural symbols. • Present a cultural symbol text generation model based on multimodal fusion and attention mechanisms. • Employ a cross-modal attention mechanism, enabling the generated text to leverage the visual features of images and the semantic features of text. • Link the specific visual information of images with the cultural context of the text, resulting in text that is both richer and more precise in conveying visual details and cultural symbolism

Applied Soft ComputingVol. 192
Fujian Normal University (CN), Chongqing University (CN)
Quality Education
Openalex Percentile: Top 68%
Multimodal Machine Learning Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.