HLAS: An Enhanced Abstractive Summarization Method Based on Hybrid Loss Optimization

The conventional training of summarization models using maximum likelihood loss faces a challenge: the discrepancy between training and evaluation objectives. Training minimizes token-level loss, while evaluation focuses on sentence or document quality, leading to less effective results. To address this, we propose the Hybrid Loss Abstractive Summarization (HLAS) framework, which combines maximum likelihood loss with global sequence prediction metrics, aligning training with evaluation. Experiments on the BillSum and GovReport datasets show that HLAS significantly outperforms baseline models, achieving higher ROUGE scores and better summarization quality.

Authors

Institutions

Publication Details

Published
2024-10-18
DOI
https://doi.org/10.1109/icmlca63499.2024.10753995
Primary Topic
Advanced Text Analysis Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

HLAS: An Enhanced Abstractive Summarization Method Based on Hybrid Loss Optimization

Yuxing Tan, Lankang Zhu, Hanhan Ma, Changyong Feng et al.
Advanced Text Analysis Techniques
article

HLAS: An Enhanced Abstractive Summarization Method Based on Hybrid Loss Optimization

Yuxing Tan, Lankang Zhu, Hanhan Ma, Changyong Feng, Ji Yuan, Penghao Wang, Hao Chen, Yang Shu, Li Cui
article en

Abstract

The conventional training of summarization models using maximum likelihood loss faces a challenge: the discrepancy between training and evaluation objectives. Training minimizes token-level loss, while evaluation focuses on sentence or document quality, leading to less effective results. To address this, we propose the Hybrid Loss Abstractive Summarization (HLAS) framework, which combines maximum likelihood loss with global sequence prediction metrics, aligning training with evaluation. Experiments on the BillSum and GovReport datasets show that HLAS significantly outperforms baseline models, achieving higher ROUGE scores and better summarization quality.

Jiaxing Hengchuang Electric Design and Research Institute (CN), Xinjiang University (CN), Tsinghua University (CN)
Openalex Percentile: Top 81%
Advanced Text Analysis Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

HLAS: An Enhanced Abstractive Summarization Method Based on Hybrid Loss Optimization — Yuxing Tan, Lankang Zhu, et al. · (2024) | TGRS Research Map | TGRS