Croissant: A Metadata Format for ML-Ready Datasets

Data is a critical resource for machine learning (ML), yet working with data remains a key friction point. This paper introduces Croissant, a metadata format for datasets that creates a shared representation across ML tools, frameworks, and platforms. Croissant makes datasets more discoverable, portable, and interoperable, thereby addressing significant challenges in ML data management. Croissant is already supported by several popular dataset repositories, spanning hundreds of thousands of datasets, enabling easy loading into the most commonly-used ML frameworks, regardless of where the data is stored. Our initial evaluation by human raters shows that Croissant metadata is readable, understandable, complete, yet concise.

Institutions

Publication Details

Journal
KNAW Research Portal (The Royal Netherlands Academy of Arts and Sciences)
Published
2024-12-12
Citations
1
Primary Topic
Photorefractive and Nonlinear Optics
Type
article
Field-Weighted Citation Impact
0.34

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Croissant: A Metadata Format for ML-Ready Datasets

1 citations
KNAW Research Portal (The Royal Netherlands Academy of Arts and Sciences)
Photorefractive and Nonlinear Optics
0.34
article

Croissant: A Metadata Format for ML-Ready Datasets

article en
1 citations

Abstract

Data is a critical resource for machine learning (ML), yet working with data remains a key friction point. This paper introduces Croissant, a metadata format for datasets that creates a shared representation across ML tools, frameworks, and platforms. Croissant makes datasets more discoverable, portable, and interoperable, thereby addressing significant challenges in ML data management. Croissant is already supported by several popular dataset repositories, spanning hundreds of thousands of datasets, enabling easy loading into the most commonly-used ML frameworks, regardless of where the data is stored. Our initial evaluation by human raters shows that Croissant metadata is readable, understandable, complete, yet concise.

KNAW Research Portal (The Royal Netherlands Academy of Arts and Sciences)
King's College London (GB), Data Archiving and Networked Services (DANS) (NL), University of Southampton (GB), Eindhoven University of Technology (NL)
European Commission, Electronic Components and Systems for European Leadership, Research Executive Agency
Openalex Percentile: Top 36%
Photorefractive and Nonlinear Optics
0.34
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.