Two definitions to characterize the relations between columns in a given scholarly metadata data set

Abstract Data cleaning is an essential step in a bibliometric analysis. Methods and tools to identify duplicates, inconsistencies, and errors in data sets from bibliographic databases such as OpenAlex and Dimensions are of particular interest. Existing data cleaning procedures usually rely on the handling of each column of a data set independently. The aim of this article is to introduce definitions and tools together with applications in order to foster greater exploitation of potentially implicit dependencies between columns in any given data set. The article introduces two relations, the parent-child relation and the coarser-finer relation, aiming to describe relations between columns in a given data set. As tools, we introduce two diagrams, the monotony diagram and the dependency diagram, aiming to give an overview of the most relevant relations. We also introduce one statistic, the conditional proportion of observed values, aiming to evaluate the completeness of one field relative to the observed values of another one. Applications highlight how the identification of relations and the generation of diagrams can be used to explore and clean data. The tools introduced are not limited to exploratory purposes and data cleaning, however. Further potential applications are discussed.

Authors

Institutions

Publication Details

Journal
Quantitative Science Studies
Published
2025-01-01
DOI
https://doi.org/10.1162/qss_a_00362
Primary Topic
Semantic Web and Ontologies
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Two definitions to characterize the relations between columns in a given scholarly metadata data set

Simon Willemin
Quantitative Science Studies
Semantic Web and Ontologies
article

Two definitions to characterize the relations between columns in a given scholarly metadata data set

Simon Willemin
article en

Abstract

Abstract Data cleaning is an essential step in a bibliometric analysis. Methods and tools to identify duplicates, inconsistencies, and errors in data sets from bibliographic databases such as OpenAlex and Dimensions are of particular interest. Existing data cleaning procedures usually rely on the handling of each column of a data set independently. The aim of this article is to introduce definitions and tools together with applications in order to foster greater exploitation of potentially implicit dependencies between columns in any given data set. The article introduces two relations, the parent-child relation and the coarser-finer relation, aiming to describe relations between columns in a given data set. As tools, we introduce two diagrams, the monotony diagram and the dependency diagram, aiming to give an overview of the most relevant relations. We also introduce one statistic, the conditional proportion of observed values, aiming to evaluate the completeness of one field relative to the observed values of another one. Applications highlight how the identification of relations and the generation of diagrams can be used to explore and clean data. The tools introduced are not limited to exploratory purposes and data cleaning, however. Further potential applications are discussed.

Quantitative Science StudiesVol. 6
ETH Zurich (CH)
Eidgenössische Technische Hochschule Zürich
Openalex Percentile: Top 97%
Semantic Web and Ontologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Two definitions to characterize the relations between columns in a given scholarly metadata data set — Simon Willemin · Quantitative Science Studies (2025) | TGRS Research Map | TGRS