TANGO: Inter-Job and Intra-Job Orchestration for Distributed Learning on Heterogeneous Wireless IoT Clusters

Distributed learning on wireless Internet of Things (IoT) clusters requires coordination of shared communication resources and heterogeneous device capacities. Concurrent synchronous training jobs can generate overlapping communication bursts, while memory limits and thermal throttling alter their execution rates. We present TANGO, a hierarchical closed-loop co-scheduler that couples inter-job synchronization control with intra-job runtime adaptation. The inter-job controller coordinates collective timing and adjusts gradient accumulation to regulate synchronization frequency using congestion feedback. The intra-job controller adapts batch size, learning rate, and input-pipeline settings within an admissible configuration region, while reporting telemetry that updates inter-job decisions. We evaluate TANGO on a 12-node heterogeneous Raspberry Pi 5 testbed with nine vision and text workloads. Under a 50-job Poisson trace, TANGO reduces average job completion time by 16.8\%, makespan by 18.0\%, and P99 queueing delay by 19.7\% relative to Sia. Differences in final accuracy from Sia remain below 1\% point for the three reported workloads at the evaluated training budgets. Trace-driven simulations extend the evaluation to 2{,}048 nodes. These results support the usefulness of coupled communication and execution control for the evaluated contention-heavy edge-learning setting.

Authors

Institutions

Publication Details

Journal
Research Square
Published
2026-11-18
DOI
https://doi.org/10.21203/rs.3.rs-11264552/v1
Primary Topic
IoT and Edge/Fog Computing
Type
preprint

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

TANGO: Inter-Job and Intra-Job Orchestration for Distributed Learning on Heterogeneous Wireless IoT Clusters

Huh Eui-Nam, Teh-Jen Sun, Md Nahid Sultan
3 links
Research Square
IoT and Edge/Fog Computing
preprint

TANGO: Inter-Job and Intra-Job Orchestration for Distributed Learning on Heterogeneous Wireless IoT Clusters

Huh Eui-Nam, Teh-Jen Sun, Md Nahid Sultan
preprint en

Abstract

Distributed learning on wireless Internet of Things (IoT) clusters requires coordination of shared communication resources and heterogeneous device capacities. Concurrent synchronous training jobs can generate overlapping communication bursts, while memory limits and thermal throttling alter their execution rates. We present TANGO, a hierarchical closed-loop co-scheduler that couples inter-job synchronization control with intra-job runtime adaptation. The inter-job controller coordinates collective timing and adjusts gradient accumulation to regulate synchronization frequency using congestion feedback. The intra-job controller adapts batch size, learning rate, and input-pipeline settings within an admissible configuration region, while reporting telemetry that updates inter-job decisions. We evaluate TANGO on a 12-node heterogeneous Raspberry Pi 5 testbed with nine vision and text workloads. Under a 50-job Poisson trace, TANGO reduces average job completion time by 16.8\%, makespan by 18.0\%, and P99 queueing delay by 19.7\% relative to Sia. Differences in final accuracy from Sia remain below 1\% point for the three reported workloads at the evaluated training budgets. Trace-driven simulations extend the evaluation to 2{,}048 nodes. These results support the usefulness of coupled communication and execution control for the evaluated contention-heavy edge-learning setting.

Research Square
Kyung Hee University (KR)
Ministry of Science and ICT, South Korea, Institute for Information and Communications Technology Promotion
IoT and Edge/Fog Computing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon