FAIR Data Assessment Using LLMs: The Fair-Way
As part of modern research practices, the FAIR data principles have become essential for data discoverability, usability, and sharing.Existing implementations for automatically assessing FAIR adherence (FAIRness) often suffer from limited usability, inconsistent accuracy, and difficult-to-interpret results, as they require explicit rules to cover for specific FAIR assessment frameworks, which are not easy to generalize.This paper introduces Fair-Way, an open source tool that leverages Large Language Models (LLMs) to automate FAIRness assessment.Fair-Way applies a divide-and-conquer approach to decompose the assessment process into fine-grained tasks, as well as to split the metadata into manageable chunks.Evaluation demonstrates that Fair-Way achieves performance comparable to existing tools, while outperforming them in several key metrics.Moreover, Fair-Way generalizes across FAIR assessment indicators without requiring explicitly programmed logic and supports both structured and unstructured metadata in diverse formats.Finally, it enables user-defined, domain-specific tests, which are typically not supported by other systems.Overall, Fair-Way represents a scalable and flexible solution to accelerate FAIR data practices across research domains.
Authors
- Christoph Lange (ORCID: https://orcid.org/0000-0001-9879-3827)
- Sayed Hoseini (ORCID: https://orcid.org/0000-0002-4489-9025)
- Fidan Limani (ORCID: https://orcid.org/0000-0002-5835-2784)
- Zeyd Boukhers (ORCID: https://orcid.org/0000-0001-9778-9164)
- Sulayman K. Sowe (ORCID: https://orcid.org/0000-0002-8605-2009)
- Stefan Decker (ORCID: https://orcid.org/0000-0001-6324-7164)
- Soo-Yon Kim (ORCID: https://orcid.org/0000-0001-5975-0031)
- A. Sharma (ORCID: https://orcid.org/0009-0004-6730-1534)
Institutions
- ZBW – Leibniz-Informationszentrum Wirtschaft (DE)
- Fraunhofer Institute for Production Technology IPT (DE)
- Fraunhofer Institute for Applied Information Technology (DE)
- Hochschule Niederrhein (DE)
- RWTH Aachen University (DE)
Publication Details
- Published
- 2025-11-10
- DOI
- https://doi.org/10.1145/3746252.3760811
- Primary Topic
- Research Data Management Practices
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Deutsche Forschungsgemeinschaft