Automatisk summering av lagligt bindande kontrakt med hjälp av LLM

The precise and technical language used in legal contexts is essential to ensure that the law is interpreted and enforced appropriately, but it also makes the language of the law inaccessible. Violating the terms of a contract, even unintentionally, can have severe consequences. But retaining legal counsel is costly, and reading through a contract is timeconsuming regardless of legal knowledge. This study explores the effectiveness of using Large Language Models (LLMs) to generate summaries of legally binding agreements (LBA) and whether it can address these concerns. By evaluating the quality of summaries of terms of service (TOS) agreements generated by LLMs using ROUGE and BERTScore metrics with gold standard reference summaries, it was determined that the summaries had a high word similarity and a notable semantic likeness. Furthermore, qualitative analysis revealed that errors in summaries generated by LLMs were relatively rare, indicating that LLM can generate accurate summaries of LBAs, and that this process could be a significant improvement and provide value for organizations and individuals.

Publication Details

Journal
KTH Publication Database DiVA (KTH Royal Institute of Technology)
Published
2025-01-01
Primary Topic
Judicial and Constitutional Studies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Automatisk summering av lagligt bindande kontrakt med hjälp av LLM

KTH Publication Database DiVA (KTH Royal Institute of Technology)
Judicial and Constitutional Studies
article

Automatisk summering av lagligt bindande kontrakt med hjälp av LLM

article en

Abstract

The precise and technical language used in legal contexts is essential to ensure that the law is interpreted and enforced appropriately, but it also makes the language of the law inaccessible. Violating the terms of a contract, even unintentionally, can have severe consequences. But retaining legal counsel is costly, and reading through a contract is timeconsuming regardless of legal knowledge. This study explores the effectiveness of using Large Language Models (LLMs) to generate summaries of legally binding agreements (LBA) and whether it can address these concerns. By evaluating the quality of summaries of terms of service (TOS) agreements generated by LLMs using ROUGE and BERTScore metrics with gold standard reference summaries, it was determined that the summaries had a high word similarity and a notable semantic likeness. Furthermore, qualitative analysis revealed that errors in summaries generated by LLMs were relatively rare, indicating that LLM can generate accurate summaries of LBAs, and that this process could be a significant improvement and provide value for organizations and individuals.

KTH Publication Database DiVA (KTH Royal Institute of Technology)
Peace, Justice and strong institutions
Openalex Percentile: Top 34%
Judicial and Constitutional Studies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.