Dynamic Resource Scheduling for Real-Time Multimodal Inference on Heterogeneous Edge Devices: A Trace-Calibrated Study of Deadline-Aware Audio–Visual Scheduling

Real-time multimodal inference couples resource-intensive visual and acoustic feature extraction with latency-sensitive fusion. Heterogeneous edge nodes can offer unequal execution times, while static routing ignores queue states and request deadlines. This paper investigates a low-overhead dynamic routing scheme, EDF-ECT, which combines estimated completion-time placement with non-preemptive earliest-deadline-first local queues. A compact dual-branch convolutional graph is timed on a CPU using three threading configurations; 432 measured invocations calibrate three virtual service profiles. An event-driven replay evaluates six policies using workload-adjusted arrival rates and common per-request service samples. Across eight independent traces per setting at nominal load 0.95, EDF-ECT improves the deadline-hit rate from 94.57% to 97.07% for balanced traffic and from 96.92% to 99.27% for large-input-heavy traffic. Paired 95% confidence intervals for the gains are [1.73, 3.26] and [1.96, 2.75] percentage points. Deadline gains trade off against unconditional p95 response time. The findings provide a reproducible request-level scheduler study with measured service kernels while distinguishing virtual workers from physical edge devices.

Authors

Institutions

Publication Details

Journal
Journal of Computing and Electronic Information Management
Published
2026-11-12
DOI
https://doi.org/10.54097/r75exk30
Primary Topic
Real-Time Systems Scheduling
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Dynamic Resource Scheduling for Real-Time Multimodal Inference on Heterogeneous Edge Devices: A Trace-Calibrated Study of Deadline-Aware Audio–Visual Scheduling

Aisling O’Connor
Journal of Computing and Electronic Information Management
Real-Time Systems Scheduling
article

Dynamic Resource Scheduling for Real-Time Multimodal Inference on Heterogeneous Edge Devices: A Trace-Calibrated Study of Deadline-Aware Audio–Visual Scheduling

Aisling O’Connor
article en

Abstract

Real-time multimodal inference couples resource-intensive visual and acoustic feature extraction with latency-sensitive fusion. Heterogeneous edge nodes can offer unequal execution times, while static routing ignores queue states and request deadlines. This paper investigates a low-overhead dynamic routing scheme, EDF-ECT, which combines estimated completion-time placement with non-preemptive earliest-deadline-first local queues. A compact dual-branch convolutional graph is timed on a CPU using three threading configurations; 432 measured invocations calibrate three virtual service profiles. An event-driven replay evaluates six policies using workload-adjusted arrival rates and common per-request service samples. Across eight independent traces per setting at nominal load 0.95, EDF-ECT improves the deadline-hit rate from 94.57% to 97.07% for balanced traffic and from 96.92% to 99.27% for large-input-heavy traffic. Paired 95% confidence intervals for the gains are [1.73, 3.26] and [1.96, 2.75] percentage points. Deadline gains trade off against unconditional p95 response time. The findings provide a reproducible request-level scheduler study with measured service kernels while distinguishing virtual workers from physical edge devices.

Journal of Computing and Electronic Information ManagementVol. 23(2)
University College Dublin (IE)
Real-Time Systems Scheduling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon