Enhancing Meeting Summarization Models via Large Language Model Data Generation and Weighted Sampling

Meeting summaries improve team communication and decision-making efficiency by extracting key information and decisions. However, due to the complexity of organizing meeting records and the need to protect the privacy of participants, available datasets are often very scarce, which restricts the development and application of meeting summary technology. Existing data augmentation techniques usually expand the data set by transforming or reconstructing the existing data samples to improve the generalization ability of the model. This leads to a model that does not generalize well when faced with unseen data. Therefore, this paper proposes a data augmentation method for meeting summaries based on large language models, which is implemented by sequential expansion method and weight sampling strategy. First, considering that the length of text data generated by large language models cannot meet the requirements of meeting datasets, we propose a novel sequential expansion method to increase the length of generated meeting data and ensure the consistency of its context. Secondly, due to the imbalanced influence of the original dataset and the generated dataset during model training, we use a weighted sampling strategy to balance them and ensure that both can achieve stable learning. Experiments on the AMI dataset show that the performance of meeting summarization is significantly improved by applying this method to the current best pre-trained meeting summary model DIALOGLED-large.

Authors

Institutions

Publication Details

Published
2024-10-11
DOI
https://doi.org/10.1109/icceic64099.2024.10775673
Citations
1
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.35
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Enhancing Meeting Summarization Models via Large Language Model Data Generation and Weighted Sampling

Guoyu Qiu, Yiteng Pan
1 citations
Topic Modeling
0.35
article

Enhancing Meeting Summarization Models via Large Language Model Data Generation and Weighted Sampling

Guoyu Qiu, Yiteng Pan
article en
1 citations

Abstract

Meeting summaries improve team communication and decision-making efficiency by extracting key information and decisions. However, due to the complexity of organizing meeting records and the need to protect the privacy of participants, available datasets are often very scarce, which restricts the development and application of meeting summary technology. Existing data augmentation techniques usually expand the data set by transforming or reconstructing the existing data samples to improve the generalization ability of the model. This leads to a model that does not generalize well when faced with unseen data. Therefore, this paper proposes a data augmentation method for meeting summaries based on large language models, which is implemented by sequential expansion method and weight sampling strategy. First, considering that the length of text data generated by large language models cannot meet the requirements of meeting datasets, we propose a novel sequential expansion method to increase the length of generated meeting data and ensure the consistency of its context. Secondly, due to the imbalanced influence of the original dataset and the generated dataset during model training, we use a weighted sampling strategy to balance them and ensure that both can achieve stable learning. Experiments on the AMI dataset show that the performance of meeting summarization is significantly improved by applying this method to the current best pre-trained meeting summary model DIALOGLED-large.

Dongguan University of Technology (CN)
Openalex Percentile: Top 31%
Topic Modeling
0.35
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.