HLAS: An Enhanced Abstractive Summarization Method Based on Hybrid Loss Optimization
The conventional training of summarization models using maximum likelihood loss faces a challenge: the discrepancy between training and evaluation objectives. Training minimizes token-level loss, while evaluation focuses on sentence or document quality, leading to less effective results. To address this, we propose the Hybrid Loss Abstractive Summarization (HLAS) framework, which combines maximum likelihood loss with global sequence prediction metrics, aligning training with evaluation. Experiments on the BillSum and GovReport datasets show that HLAS significantly outperforms baseline models, achieving higher ROUGE scores and better summarization quality.
Authors
- Yuxing Tan
- Lankang Zhu
- Hanhan Ma
- Changyong Feng (ORCID: https://orcid.org/0000-0002-4432-1565)
- Ji Yuan
- Penghao Wang (ORCID: https://orcid.org/0009-0005-8431-5388)
- Hao Chen (ORCID: https://orcid.org/0000-0002-9822-6168)
- Yang Shu (ORCID: https://orcid.org/0009-0007-8647-4117)
- Li Cui
Institutions
- Jiaxing Hengchuang Electric Design and Research Institute (CN)
- Xinjiang University (CN)
- Tsinghua University (CN)
Publication Details
- Published
- 2024-10-18
- DOI
- https://doi.org/10.1109/icmlca63499.2024.10753995
- Primary Topic
- Advanced Text Analysis Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00