Benchmarking single-cell format conversion tools reveals interoperability gaps and introduces CrossCell for reliable cross-ecosystem data exchange

Single-cell RNA sequencing (scRNA-seq) analysis relies on two ecosystems—R (Seurat/Bioconductor) and Python (Scanpy/AnnData)—whose formats, RDS and H5AD, are not natively interoperable. Although conversion tools exist, no systematic benchmark has evaluated their reliability, performance, or data fidelity across diverse datasets and directions. We present a systematic and comprehensive benchmark of five tools (Zellkonverter, anndataR, convert2anndata, easySCF, CrossCell) across seven dimensions: conversion robustness, runtime performance, memory efficiency, expression fidelity, metadata type integrity, Seurat V5 compatibility, and large-scale scalability. The benchmark covers 68 datasets ranging from 1,438 to 1,665,937 cells. We identify a substantial gap in H5AD-to-RDS conversion. Cross-language Foreign function interface boundaries introduce implicit type changes (e.g., Int32 to Float64) that can affect downstream data compliance. Existing tools already fail extensively on datasets below 74,000 cells, leaving large-scale conversion unaddressed. CrossCell-a Rust-based, runtime-independent toolkit introduced as part of this benchmark — achieves 100% success across all 55 standard datasets, delivers 2.5–4.9 × speedups and 37–61% memory savings over competing tools, and successfully converts 13 CELLxGENE datasets up to 1.67 million cells. This study exposes critical interoperability gaps and failure modes, providing the community with tool selection guidelines and best practices for cross-ecosystem data exchange. The fully containerized benchmark suite (68 datasets, 7 dimensions, one-click reproducibility) constitutes the first reproducible evaluation framework for this domain and can be directly applied to assess future tools. The runtime-independent design paradigm offers a viable path toward resolving cross-language data exchange bottlenecks.

Authors

Institutions

Publication Details

Journal
BMC Genomics
Published
2026-07-22
DOI
https://doi.org/10.1186/s12864-026-13198-5
Primary Topic
Single-cell and spatial transcriptomics
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Benchmarking single-cell format conversion tools reveals interoperability gaps and introduces CrossCell for reliable cross-ecosystem data exchange

Y Zhang, Zi Wang, Wei Han, Z W Wu et al.
BMC Genomics
Single-cell and spatial transcriptomics
article

Benchmarking single-cell format conversion tools reveals interoperability gaps and introduces CrossCell for reliable cross-ecosystem data exchange

Y Zhang, Zi Wang, Wei Han, Z W Wu, J H Yu
article en

Abstract

Single-cell RNA sequencing (scRNA-seq) analysis relies on two ecosystems—R (Seurat/Bioconductor) and Python (Scanpy/AnnData)—whose formats, RDS and H5AD, are not natively interoperable. Although conversion tools exist, no systematic benchmark has evaluated their reliability, performance, or data fidelity across diverse datasets and directions. We present a systematic and comprehensive benchmark of five tools (Zellkonverter, anndataR, convert2anndata, easySCF, CrossCell) across seven dimensions: conversion robustness, runtime performance, memory efficiency, expression fidelity, metadata type integrity, Seurat V5 compatibility, and large-scale scalability. The benchmark covers 68 datasets ranging from 1,438 to 1,665,937 cells. We identify a substantial gap in H5AD-to-RDS conversion. Cross-language Foreign function interface boundaries introduce implicit type changes (e.g., Int32 to Float64) that can affect downstream data compliance. Existing tools already fail extensively on datasets below 74,000 cells, leaving large-scale conversion unaddressed. CrossCell-a Rust-based, runtime-independent toolkit introduced as part of this benchmark — achieves 100% success across all 55 standard datasets, delivers 2.5–4.9 × speedups and 37–61% memory savings over competing tools, and successfully converts 13 CELLxGENE datasets up to 1.67 million cells. This study exposes critical interoperability gaps and failure modes, providing the community with tool selection guidelines and best practices for cross-ecosystem data exchange. The fully containerized benchmark suite (68 datasets, 7 dimensions, one-click reproducibility) constitutes the first reproducible evaluation framework for this domain and can be directly applied to assess future tools. The runtime-independent design paradigm offers a viable path toward resolving cross-language data exchange bottlenecks.

BMC Genomics
Stomatology Hospital (CN), Nanjing Medical University (CN)
Openalex Percentile: Top 14%
Single-cell and spatial transcriptomics
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.