Storing Mass-Spectrometry Data in Simple Databases Enables Flexible and Intuitive Exploration without Time or Space Penalties

Mass spectrometry (MS) generates large data sets that are stored in increasingly optimized and complex file types, demanding technical expertise to extract information rapidly and easily. We wondered whether a simple structured query language (SQL) database could hold raw MS data and allow for easily readable queries without incurring major penalties in the read time or disk space relative to other popular MS formats. Here, we describe a basic MS schema with intuitive database tables and fields that can outperform other formats for exploratory and interactive analysis according to six data subsets commonly extracted: single scans (both MS<sup>1</sup> and MS<sup>2</sup>), ion chromatograms, retention time ranges, and fragmentation searches (both precursor and fragment search). Additionally, we compare SQLite, DuckDB, and Parquet implementations and find that they can perform these tasks in under a second, even when the files occupy over a gigabyte of data on the disk. We believe that this tidy data schema expands nicely to most forms of MS data and offers a way to transparently query data sets while preserving computational performance.

Authors

Institutions

Publication Details

Journal
Journal of Proteome Research
Published
2025-11-24
DOI
https://doi.org/10.1021/acs.jproteome.5c00721
Primary Topic
Mass Spectrometry Techniques and Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Storing Mass-Spectrometry Data in Simple Databases Enables Flexible and Intuitive Exploration without Time or Space Penalties

Anitra E. Ingalls, William Kumler, Sam LaRue
Journal of Proteome Research
Mass Spectrometry Techniques and Applications
article

Storing Mass-Spectrometry Data in Simple Databases Enables Flexible and Intuitive Exploration without Time or Space Penalties

Anitra E. Ingalls, William Kumler, Sam LaRue
article en

Abstract

Mass spectrometry (MS) generates large data sets that are stored in increasingly optimized and complex file types, demanding technical expertise to extract information rapidly and easily. We wondered whether a simple structured query language (SQL) database could hold raw MS data and allow for easily readable queries without incurring major penalties in the read time or disk space relative to other popular MS formats. Here, we describe a basic MS schema with intuitive database tables and fields that can outperform other formats for exploratory and interactive analysis according to six data subsets commonly extracted: single scans (both MS<sup>1</sup> and MS<sup>2</sup>), ion chromatograms, retention time ranges, and fragmentation searches (both precursor and fragment search). Additionally, we compare SQLite, DuckDB, and Parquet implementations and find that they can perform these tasks in under a second, even when the files occupy over a gigabyte of data on the disk. We believe that this tidy data schema expands nicely to most forms of MS data and offers a way to transparently query data sets while preserving computational performance.

Journal of Proteome ResearchVol. 24(12)
University of Washington (US)
Openalex Percentile: Top 67%
Mass Spectrometry Techniques and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Storing Mass-Spectrometry Data in Simple Databases Enables Flexible and Intuitive Exploration without Time or Space Penalties — Anitra E. Ingalls, William Kumler, et al. · Journal of Proteome Research (2025) | TGRS Research Map | TGRS