A Dual-Camera Edge Sensing Framework with Zone-Aware Multi-Object Tracking for Sensorless Smart Vending Cabinets

Top-loading smart vending cabinets require precise transaction-level product detection under strict hardware and deployment constraints. In this paper, “sensorless” refers specifically to the absence of auxiliary product-level sensing hardware, such as RFID tags, weight sensors, shelf load cells, or product-slot instrumentation; the system still uses two camera sensors. Conventional snapshot-difference methods compare only a small number of frames at the beginning and end of a transaction and therefore cannot explicitly represent intermediate product motion, such as pickup, return, inspection, occlusion, and shelf resettling. This paper proposes ZAB-Fusion, a dual-camera edge sensing framework with zone-aware multi-object tracking for sensorless smart vending cabinets. The framework combines a YOLO11-seg and RT-DETR detection ensemble with ByteTrack temporal association, projects product tracks into a three-zone vertical cabinet model, interprets compressed zone sequences using a finite-state event classifier, and integrates camera-specific event streams through an evidence-gated cross-camera fusion rule. The proposed method was evaluated on 220 in-service vending transactions containing 227 ground-truth TAKEN events and 87 RETURNED events across seven product classes. Compared with the snapshot-difference baseline, ZAB-Fusion improved recall from 0.665 to 0.925 and F1-score from 0.780 to 0.944, while maintaining a high precision of 0.963. At the transaction level, exact receipt accuracy increased from 0.645 to 0.900. Runtime analysis on an Intel N100 CPU-only edge device showed an average processing latency of 562 ms per transaction under the selected-frame inference protocol. The zone classification, finite-state event interpretation, and evidence-gated cross-camera fusion stages required only 3 ms in total. These results demonstrate that explicit motion semantics and auditable cross-camera evidence gating can improve sensorless retail transaction level recognition in sensorless smart vending cabinets without adding auxiliary product-level sensing hardware.

Authors

Institutions

Publication Details

Journal
Sensors
Published
2026-08-17
DOI
https://doi.org/10.3390/s26165213
Primary Topic
RFID technology advancements
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Dual-Camera Edge Sensing Framework with Zone-Aware Multi-Object Tracking for Sensorless Smart Vending Cabinets

Heung Seok Jeon, Abror Shavkatovich Buriboev, Abbos Abduvaytov, Cheolwon Lee et al.
Sensors
RFID technology advancements
article

A Dual-Camera Edge Sensing Framework with Zone-Aware Multi-Object Tracking for Sensorless Smart Vending Cabinets

Heung Seok Jeon, Abror Shavkatovich Buriboev, Abbos Abduvaytov, Cheolwon Lee, Farkhat Rajabov, Su-Mi Shin, Shavkat Buriboev, Giyosjon Sharipov, Rustem Allanyazov, Aziza Akhmedova, Ruzimboy Sobirov
article en

Abstract

Top-loading smart vending cabinets require precise transaction-level product detection under strict hardware and deployment constraints. In this paper, “sensorless” refers specifically to the absence of auxiliary product-level sensing hardware, such as RFID tags, weight sensors, shelf load cells, or product-slot instrumentation; the system still uses two camera sensors. Conventional snapshot-difference methods compare only a small number of frames at the beginning and end of a transaction and therefore cannot explicitly represent intermediate product motion, such as pickup, return, inspection, occlusion, and shelf resettling. This paper proposes ZAB-Fusion, a dual-camera edge sensing framework with zone-aware multi-object tracking for sensorless smart vending cabinets. The framework combines a YOLO11-seg and RT-DETR detection ensemble with ByteTrack temporal association, projects product tracks into a three-zone vertical cabinet model, interprets compressed zone sequences using a finite-state event classifier, and integrates camera-specific event streams through an evidence-gated cross-camera fusion rule. The proposed method was evaluated on 220 in-service vending transactions containing 227 ground-truth TAKEN events and 87 RETURNED events across seven product classes. Compared with the snapshot-difference baseline, ZAB-Fusion improved recall from 0.665 to 0.925 and F1-score from 0.780 to 0.944, while maintaining a high precision of 0.963. At the transaction level, exact receipt accuracy increased from 0.645 to 0.900. Runtime analysis on an Intel N100 CPU-only edge device showed an average processing latency of 562 ms per transaction under the selected-frame inference protocol. The zone classification, finite-state event interpretation, and evidence-gated cross-camera fusion stages required only 3 ms in total. These results demonstrate that explicit motion semantics and auditable cross-camera evidence gating can improve sensorless retail transaction level recognition in sensorless smart vending cabinets without adding auxiliary product-level sensing hardware.

SensorsVol. 26(16)
Gachon University (KR), Samarkand State University named after Sharof Rashidov (UZ), Namangan State University (UZ), Tashkent University of Information Technology (UZ), Konkuk University (KR), Samarkand Institute of Economics and Service (UZ), Tashkent Institute of Irrigation and Agricultural Mechanization Engineers (UZ), Namangan Engineering Pedagogical Institute (UZ), Westminster International University in Tashkent (UZ), Korea Institute of Science & Technology Information (KR)
National Research Foundation of Korea
Openalex Percentile: Top 12%
RFID technology advancements
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.