Reconstructing Shuffled Text : Bad Results for NLP, but Good News for Using In-Copyright Texts

Existing copyright laws in the European Union, the United States, and many other jurisdictions worldwide impose limitations on Text and Data Mining that affect the storage, publication, and reuse of datasets built from in-copyright texts. Therefore, derived text formats (DTFs) have been proposed. One important aspect of DTFs regarding copyright law is the reconstructibility of the source text from its corresponding DTF. In this paper we present the first of a series of experiments we plan to conduct on this issue. For this experiment, we have fine-tuned a large language model to reconstruct source texts from DTFs. The results of the reconstruction are mixed, but on the whole not very successful. This suggests that reconstructing text in DTFs is not as simple as is sometimes assumed and we believe that this result may encourage scholars to convert their in-copyright texts to DTFs and publish them as research data.

Publication Details

Journal
TUbilio (Technical University of Darmstadt)
Published
2025-01-01
DOI
https://doi.org/10.26083/tuprints-00030140
Primary Topic
Digital Humanities and Scholarship
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Reconstructing Shuffled Text : Bad Results for NLP, but Good News for Using In-Copyright Texts

TUbilio (Technical University of Darmstadt)
Digital Humanities and Scholarship
article

Reconstructing Shuffled Text : Bad Results for NLP, but Good News for Using In-Copyright Texts

article en

Abstract

Existing copyright laws in the European Union, the United States, and many other jurisdictions worldwide impose limitations on Text and Data Mining that affect the storage, publication, and reuse of datasets built from in-copyright texts. Therefore, derived text formats (DTFs) have been proposed. One important aspect of DTFs regarding copyright law is the reconstructibility of the source text from its corresponding DTF. In this paper we present the first of a series of experiments we plan to conduct on this issue. For this experiment, we have fine-tuned a large language model to reconstruct source texts from DTFs. The results of the reconstruction are mixed, but on the whole not very successful. This suggests that reconstructing text in DTFs is not as simple as is sometimes assumed and we believe that this result may encourage scholars to convert their in-copyright texts to DTFs and publish them as research data.

TUbilio (Technical University of Darmstadt)
Deutsche Forschungsgemeinschaft
Peace, Justice and strong institutions
Openalex Percentile: Top 59%
Digital Humanities and Scholarship
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.