Enumeration, Tagged Unions, Tuples, and Collections: A Novel Approach to Extracting JSON Schema

Recently, JSON became a trendy data format for representing datasets. Its success is due to embodying structure and data in the same representation. Moreover, it has a loose structure, i.e., the structure (aka schema) is not rigid. While the absence of a rigid schema brings several advantages, it is impossible to exploit some benefits of knowing the schema in advance, such as query and storage optimization and improving data curation. In this paper, we propose JFUSE, a tool to deal with the problem of discovering a schema from JSON collections. Besides inferring basic types (e.g., atomic types, arrays, and objects), JFUSE also discovers enumeration, tagged unions, metadata as data, objects as collections, and arrays as tuples. We propose a metamodel that can be easily transformed into any schema language (e.g., JSON Schema). Our experiments show that the proposed approach infers concise and correct schemas from (huge) JSON collections.

Authors

Institutions

Publication Details

Published
2024-10-14
DOI
https://doi.org/10.5753/sbbd.2024.240239
Primary Topic
Web Data Mining and Analysis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Enumeration, Tagged Unions, Tuples, and Collections: A Novel Approach to Extracting JSON Schema

Samuel da Silva Feitosa, Denio Duarte, Geomar A. Schreiner, Natália Banhara
Web Data Mining and Analysis
article

Enumeration, Tagged Unions, Tuples, and Collections: A Novel Approach to Extracting JSON Schema

Samuel da Silva Feitosa, Denio Duarte, Geomar A. Schreiner, Natália Banhara
article en

Abstract

Recently, JSON became a trendy data format for representing datasets. Its success is due to embodying structure and data in the same representation. Moreover, it has a loose structure, i.e., the structure (aka schema) is not rigid. While the absence of a rigid schema brings several advantages, it is impossible to exploit some benefits of knowing the schema in advance, such as query and storage optimization and improving data curation. In this paper, we propose JFUSE, a tool to deal with the problem of discovering a schema from JSON collections. Besides inferring basic types (e.g., atomic types, arrays, and objects), JFUSE also discovers enumeration, tagged unions, metadata as data, objects as collections, and arrays as tuples. We propose a metamodel that can be easily transformed into any schema language (e.g., JSON Schema). Our experiments show that the proposed approach infers concise and correct schemas from (huge) JSON collections.

Southern Federal University (RU)
Openalex Percentile: Top 71%
Web Data Mining and Analysis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Enumeration, Tagged Unions, Tuples, and Collections: A Novel Approach to Extracting JSON Schema — Samuel da Silva Feitosa, Denio Duarte, et al. · (2024) | TGRS Research Map | TGRS