Edge-centric optimization: a novel strategy for minimizing information loss in graph-to-text generation

Given the remarkable text generation capabilities of pre-trained language models, impressive results have been realized in graph-to-text generation. However, while learning from knowledge graphs, these language models are unable to fully grasp the structural information of the graph, leading to logical errors and missing key information. Therefore, an important research direction is to minimize the loss of graph structural information during the model training process. We propose a framework named Edge-Optimized Multi-Level Information refinement (EMLR), which aims to maximize the retention of the graph’s structural information from an edge perspective. Based on this framework, we further propose a new graph generation model, named TriELMR, highlighting the comprehensive interactive learning relationship between the model and the graph structure, as well as the importance of edges in the graph structure. TriELMR adopts three main strategies to reduce information loss during learning: (1) Knowledge Sequence Optimization; (2) EMLR Framework; and (3) Graph Activation Function. Experimental results reveal that TriELMR exhibits exceptional performance across various benchmark tests, especially on the webnlgv2.0 and Event Narrative datasets, achieving BLEU-4 scores of $$66.5\%$$ and $$37.27\%$$ , respectively, surpassing the state-of-the-art models. These demonstrate the advantages of TriELMR in maintaining the accuracy of graph structural information.

Authors

Institutions

Publication Details

Journal
Complex & Intelligent Systems
Published
2024-12-19
DOI
https://doi.org/10.1007/s40747-024-01690-y
Citations
3
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
1.04

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Edge-centric optimization: a novel strategy for minimizing information loss in graph-to-text generation

Shiqi Sun, Yuanzhuo Wang, Jianhe Cen, Yao Zheng et al.
3 citations
Complex & Intelligent Systems
Topic Modeling
1.04
article

Edge-centric optimization: a novel strategy for minimizing information loss in graph-to-text generation

Shiqi Sun, Yuanzhuo Wang, Jianhe Cen, Yao Zheng, Jingyuan Li, D P Yin
article en
3 citations

Abstract

Given the remarkable text generation capabilities of pre-trained language models, impressive results have been realized in graph-to-text generation. However, while learning from knowledge graphs, these language models are unable to fully grasp the structural information of the graph, leading to logical errors and missing key information. Therefore, an important research direction is to minimize the loss of graph structural information during the model training process. We propose a framework named Edge-Optimized Multi-Level Information refinement (EMLR), which aims to maximize the retention of the graph’s structural information from an edge perspective. Based on this framework, we further propose a new graph generation model, named TriELMR, highlighting the comprehensive interactive learning relationship between the model and the graph structure, as well as the importance of edges in the graph structure. TriELMR adopts three main strategies to reduce information loss during learning: (1) Knowledge Sequence Optimization; (2) EMLR Framework; and (3) Graph Activation Function. Experimental results reveal that TriELMR exhibits exceptional performance across various benchmark tests, especially on the webnlgv2.0 and Event Narrative datasets, achieving BLEU-4 scores of $$66.5\%$$ and $$37.27\%$$ , respectively, surpassing the state-of-the-art models. These demonstrate the advantages of TriELMR in maintaining the accuracy of graph structural information.

Complex & Intelligent SystemsVol. 11(1)
Beijing Technology and Business University (CN), Chinese Academy of Sciences (CN), Zhengzhou University (CN), Institute of Computing Technology (CN)
Tencent, National Natural Science Foundation of China
Quality Education
Openalex Percentile: Top 18%
Topic Modeling
1.04
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.