AI-driven warehouse automation: a unified edge computer vision framework for real-time package tracking and conveyor monitoring

High-speed warehouse automation depends on reliable monitoring of package flow and operational anomalies across sortation conveyors, yet conventional solutions typically deploy separate physical sensors for individual tasks. This paper presents a unified edge computer vision framework that derives multiple conveyor-monitoring functions from a single overhead camera and a shared detection-tracking pipeline. The key novelty is the use of continuous, identity-preserving package trajectory tracking and analysis as a shared basis for virtual sensors : software-defined trigger lines and detection zones. Throughput counting, doubles detection, and reversal detection are derived from the shared trajectories, while dwelling detection reuses the same per-frame detections for a periodic zone-occupancy check; all four functions are therefore served by one detector pass per processed frame, without task-specific sensing hardware or redundant inference pipelines. The framework combines a fine-tuned RF-DETR Small detector with ByteTrack multi-object tracking to generate identity-preserving package trajectories in real time. It was evaluated at an operational sortation facility, where throughput counting achieved 98.05% accuracy; doubles detection achieved 96.0% precision and reversal detection 96.6% precision, while event recall, estimated on approximately six hours of continuously annotated video, was 66.7% for doubles and 88.9% for reversals; and dwelling detection achieved 100% precision and 96.15% recall. These results show that a shared detection and trajectory-analysis backbone can provide high-precision, reconfigurable multi-task conveyor monitoring on edge hardware while supplying trajectory and video metadata unavailable from binary physical sensors, offering a practical building block for AI-driven warehouse automation.

Authors

Institutions

Publication Details

Journal
Frontiers in Artificial Intelligence
Published
2026-10-29
DOI
https://doi.org/10.3389/frai.2026.1917595
Primary Topic
Video Surveillance and Tracking Methods
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

AI-driven warehouse automation: a unified edge computer vision framework for real-time package tracking and conveyor monitoring

Farouq Halawa, Raashid Mohammed, Mohammed Mahyoub, Ankit Pandey
4 links
Frontiers in Artificial Intelligence
Video Surveillance and Tracking Methods
article

AI-driven warehouse automation: a unified edge computer vision framework for real-time package tracking and conveyor monitoring

Farouq Halawa, Raashid Mohammed, Mohammed Mahyoub, Ankit Pandey
article en

Abstract

High-speed warehouse automation depends on reliable monitoring of package flow and operational anomalies across sortation conveyors, yet conventional solutions typically deploy separate physical sensors for individual tasks. This paper presents a unified edge computer vision framework that derives multiple conveyor-monitoring functions from a single overhead camera and a shared detection-tracking pipeline. The key novelty is the use of continuous, identity-preserving package trajectory tracking and analysis as a shared basis for virtual sensors : software-defined trigger lines and detection zones. Throughput counting, doubles detection, and reversal detection are derived from the shared trajectories, while dwelling detection reuses the same per-frame detections for a periodic zone-occupancy check; all four functions are therefore served by one detector pass per processed frame, without task-specific sensing hardware or redundant inference pipelines. The framework combines a fine-tuned RF-DETR Small detector with ByteTrack multi-object tracking to generate identity-preserving package trajectories in real time. It was evaluated at an operational sortation facility, where throughput counting achieved 98.05% accuracy; doubles detection achieved 96.0% precision and reversal detection 96.6% precision, while event recall, estimated on approximately six hours of continuously annotated video, was 66.7% for doubles and 88.9% for reversals; and dwelling detection achieved 100% precision and 96.15% recall. These results show that a shared detection and trajectory-analysis backbone can provide high-precision, reconfigurable multi-task conveyor monitoring on edge hardware while supplying trajectory and video metadata unavailable from binary physical sensors, offering a practical building block for AI-driven warehouse automation.

Frontiers in Artificial IntelligenceVol. 9
Amazon (United States) (US)
Industry, innovation and infrastructure
Openalex Percentile: Top 17%
Video Surveillance and Tracking Methods
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon
AI-driven warehouse automation: a unified edge computer vision framework for real-time package tracking and conveyor monitoring — Farouq Halawa, Raashid Mohammed, et al. · Frontiers in Artificial Intelligence (2026) | TGRS Research Map | TGRS