MobHeteroCAS: Mobility-Aware DNN Task Scheduling in Heterogeneous Collaborative Autonomous Systems

Scene perception for situational awareness is crucial for autonomous agents like UGVs and UAVs that involves sensing from different 2D and 3D modalities to execute tasks such as semantic segmentation and object detection. However, UGVs and UAVs face limitations in power and computation capacity. To address these challenges, we propose an offloading framework called MobHeteroCAS , designed to leverage nearby peer autonomous vehicles for computation. Our framework addresses key challenges in offloading DNN (Deep Neural Networks) tasks in a collaborative environment: (a) Optimally offloading data/features to leverage nearby devices’ computation capabilities; (b) Reducing offloaded data for efficient communication in low-bandwidth environments; (c) MobHeteroCAS determines the optimal ”split ratio” to determine how much data should be offloaded to each nearby device based on network parameters such as RSSI values, latency incurred due to network conditions, workload, memory constraints (CPU, GPU, RAM), and power limitations. The key contribution of MobHeteroCAS is determining the optimal split ratio in stationary and mobile environments. Apart from the devices consuming more power and memory when they are mobile, the latency increases when the distance between communicating devices increases. Thus, MobHeteroCAS estimate the latency to offload the computation when devices are on mobile before selecting the optimal split ratio. MobHeteroCAS is truly fault-tolerant, incorporating the identification of device (agent) failure and task redistribution when a device fails. We empirically demonstrate that offloading DNN features instead of raw images reduces overall system latency. Therefore, we offload feature representations of raw images for tasks such as image classification and semantic segmentation. In our study, we utilize a testbed comprising three Unmanned Ground Vehicles (UGVs) and one Linux laptop, implementing a self-adaptive optimization framework capable of managing multiple heterogeneous tasks collaboratively across multiple nodes. Our evaluations, involving simultaneous execution of multiple DNN tasks like Image Classification and Semantic Segmentation, demonstrate that employing a split ratio of 30%-42%-28% (data distribution across auxiliary nodes) reduces offloading latency by approximately 72% (from 38 \(ms/data\) to 10.5 \(ms/data\) ) compared to compressed frames and reduces total operation time by approximately 99% (from 281.33 minutes to 169 seconds) compared to the baseline configuration (execution on the primary node) in stationary setting. The latency improves by 78-82%.

Authors

Institutions

Publication Details

Journal
ACM Transactions on Autonomous and Adaptive Systems
Published
2026-11-17
DOI
https://doi.org/10.1145/3862848
Primary Topic
IoT and Edge/Fog Computing
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

MobHeteroCAS: Mobility-Aware DNN Task Scheduling in Heterogeneous Collaborative Autonomous Systems

Jade Freeman, Carl Busart, Indrajeet Ghosh, Timothy Gregory et al.
3 links
ACM Transactions on Autonomous and Adaptive Systems
IoT and Edge/Fog Computing
article

MobHeteroCAS: Mobility-Aware DNN Task Scheduling in Heterogeneous Collaborative Autonomous Systems

Jade Freeman, Carl Busart, Indrajeet Ghosh, Timothy Gregory, Nirmalya Roy, Mohammad Saeid Anwar, Masud Ahmed, Emon Dey, Anuradha Ravi
article en

Abstract

Scene perception for situational awareness is crucial for autonomous agents like UGVs and UAVs that involves sensing from different 2D and 3D modalities to execute tasks such as semantic segmentation and object detection. However, UGVs and UAVs face limitations in power and computation capacity. To address these challenges, we propose an offloading framework called MobHeteroCAS , designed to leverage nearby peer autonomous vehicles for computation. Our framework addresses key challenges in offloading DNN (Deep Neural Networks) tasks in a collaborative environment: (a) Optimally offloading data/features to leverage nearby devices’ computation capabilities; (b) Reducing offloaded data for efficient communication in low-bandwidth environments; (c) MobHeteroCAS determines the optimal ”split ratio” to determine how much data should be offloaded to each nearby device based on network parameters such as RSSI values, latency incurred due to network conditions, workload, memory constraints (CPU, GPU, RAM), and power limitations. The key contribution of MobHeteroCAS is determining the optimal split ratio in stationary and mobile environments. Apart from the devices consuming more power and memory when they are mobile, the latency increases when the distance between communicating devices increases. Thus, MobHeteroCAS estimate the latency to offload the computation when devices are on mobile before selecting the optimal split ratio. MobHeteroCAS is truly fault-tolerant, incorporating the identification of device (agent) failure and task redistribution when a device fails. We empirically demonstrate that offloading DNN features instead of raw images reduces overall system latency. Therefore, we offload feature representations of raw images for tasks such as image classification and semantic segmentation. In our study, we utilize a testbed comprising three Unmanned Ground Vehicles (UGVs) and one Linux laptop, implementing a self-adaptive optimization framework capable of managing multiple heterogeneous tasks collaboratively across multiple nodes. Our evaluations, involving simultaneous execution of multiple DNN tasks like Image Classification and Semantic Segmentation, demonstrate that employing a split ratio of 30%-42%-28% (data distribution across auxiliary nodes) reduces offloading latency by approximately 72% (from 38 \(ms/data\) to 10.5 \(ms/data\) ) compared to compressed frames and reduces total operation time by approximately 99% (from 281.33 minutes to 169 seconds) compared to the baseline configuration (execution on the primary node) in stationary setting. The latency improves by 78-82%.

ACM Transactions on Autonomous and Adaptive Systems
DEVCOM Army Research Laboratory (US), United States Army Combat Capabilities Development Command (US), Information Systems Laboratories (United States) (US), NCI Information Systems (United States) (US), University of Maryland, Baltimore County (US)
Industry, innovation and infrastructure
IoT and Edge/Fog Computing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon