Optimizing Edge Telemetry Synchronization: Benchmarking Durability Primitives and Micro-Batching Resilience in Resource-Constrained Environments

Edge deployments in remote areas frequently suffer from network partitions, dropped packets, and limited flash storage write cycles. While SQLite offers simple embedded ACID storage, the overhead of strict write durability during offline periods and subsequent recovery across degraded links is rarely measured together. In this work, we benchmark SQLite Write-Ahead Logging (WAL) settings and micro-batch network recovery over both clean and degraded links (250 ms delay, 15% packet drop). We observed that per-sample disk syncs (PRAGMA synchronous = FULL) impose a 359x write penalty compared to NORMAL mode. For egress, single-record streaming (N = 1) under degraded conditions caused synchronization time to spike from 1,038.9 ms to 228,232.6 ms (~3.8 minutes), triggering 15 socket timeouts. Grouping records into micro-batches of N >= 50 cut synchronization time down to 2,069.0 ms (a 99.1% drop) and eliminated dropped connections entirely.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-08-21
DOI
https://doi.org/10.5281/zenodo.22050099
Primary Topic
Advanced Data Storage Technologies
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Optimizing Edge Telemetry Synchronization: Benchmarking Durability Primitives and Micro-Batching Resilience in Resource-Constrained Environments

Anantdeep Singh
Zenodo (CERN European Organization for Nuclear Research)
Advanced Data Storage Technologies
preprint

Optimizing Edge Telemetry Synchronization: Benchmarking Durability Primitives and Micro-Batching Resilience in Resource-Constrained Environments

Anantdeep Singh
preprint en

Abstract

Edge deployments in remote areas frequently suffer from network partitions, dropped packets, and limited flash storage write cycles. While SQLite offers simple embedded ACID storage, the overhead of strict write durability during offline periods and subsequent recovery across degraded links is rarely measured together. In this work, we benchmark SQLite Write-Ahead Logging (WAL) settings and micro-batch network recovery over both clean and degraded links (250 ms delay, 15% packet drop). We observed that per-sample disk syncs (PRAGMA synchronous = FULL) impose a 359x write penalty compared to NORMAL mode. For egress, single-record streaming (N = 1) under degraded conditions caused synchronization time to spike from 1,038.9 ms to 228,232.6 ms (~3.8 minutes), triggering 15 socket timeouts. Grouping records into micro-batches of N >= 50 cut synchronization time down to 2,069.0 ms (a 99.1% drop) and eliminated dropped connections entirely.

Zenodo (CERN European Organization for Nuclear Research)
Punjab Technical University (IN)
Advanced Data Storage Technologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Optimizing Edge Telemetry Synchronization: Benchmarking Durability Primitives and Micro-Batching Resilience in Resource-Constrained Environments — Anantdeep Singh · Zenodo (CERN European Organization for Nuclear Research) (2026) | TGRS Research Map | TGRS