FAIR Data Assessment Using LLMs: The Fair-Way

As part of modern research practices, the FAIR data principles have become essential for data discoverability, usability, and sharing.Existing implementations for automatically assessing FAIR adherence (FAIRness) often suffer from limited usability, inconsistent accuracy, and difficult-to-interpret results, as they require explicit rules to cover for specific FAIR assessment frameworks, which are not easy to generalize.This paper introduces Fair-Way, an open source tool that leverages Large Language Models (LLMs) to automate FAIRness assessment.Fair-Way applies a divide-and-conquer approach to decompose the assessment process into fine-grained tasks, as well as to split the metadata into manageable chunks.Evaluation demonstrates that Fair-Way achieves performance comparable to existing tools, while outperforming them in several key metrics.Moreover, Fair-Way generalizes across FAIR assessment indicators without requiring explicitly programmed logic and supports both structured and unstructured metadata in diverse formats.Finally, it enables user-defined, domain-specific tests, which are typically not supported by other systems.Overall, Fair-Way represents a scalable and flexible solution to accelerate FAIR data practices across research domains.

Authors

Institutions

Publication Details

Published
2025-11-10
DOI
https://doi.org/10.1145/3746252.3760811
Primary Topic
Research Data Management Practices
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

FAIR Data Assessment Using LLMs: The Fair-Way

Christoph Lange, Sayed Hoseini, Fidan Limani, Zeyd Boukhers et al.
Research Data Management Practices
article

FAIR Data Assessment Using LLMs: The Fair-Way

Christoph Lange, Sayed Hoseini, Fidan Limani, Zeyd Boukhers, Sulayman K. Sowe, Stefan Decker, Soo-Yon Kim, A. Sharma
article en

Abstract

As part of modern research practices, the FAIR data principles have become essential for data discoverability, usability, and sharing.Existing implementations for automatically assessing FAIR adherence (FAIRness) often suffer from limited usability, inconsistent accuracy, and difficult-to-interpret results, as they require explicit rules to cover for specific FAIR assessment frameworks, which are not easy to generalize.This paper introduces Fair-Way, an open source tool that leverages Large Language Models (LLMs) to automate FAIRness assessment.Fair-Way applies a divide-and-conquer approach to decompose the assessment process into fine-grained tasks, as well as to split the metadata into manageable chunks.Evaluation demonstrates that Fair-Way achieves performance comparable to existing tools, while outperforming them in several key metrics.Moreover, Fair-Way generalizes across FAIR assessment indicators without requiring explicitly programmed logic and supports both structured and unstructured metadata in diverse formats.Finally, it enables user-defined, domain-specific tests, which are typically not supported by other systems.Overall, Fair-Way represents a scalable and flexible solution to accelerate FAIR data practices across research domains.

ZBW – Leibniz-Informationszentrum Wirtschaft (DE), Fraunhofer Institute for Production Technology IPT (DE), Fraunhofer Institute for Applied Information Technology (DE), Hochschule Niederrhein (DE), RWTH Aachen University (DE)
Deutsche Forschungsgemeinschaft
Openalex Percentile: Top 53%
Research Data Management Practices
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

FAIR Data Assessment Using LLMs: The Fair-Way — Christoph Lange, Sayed Hoseini, et al. · (2025) | TGRS Research Map | TGRS