A Dual-Camera Edge Sensing Framework with Zone-Aware Multi-Object Tracking for Sensorless Smart Vending Cabinets
Top-loading smart vending cabinets require precise transaction-level product detection under strict hardware and deployment constraints. In this paper, “sensorless” refers specifically to the absence of auxiliary product-level sensing hardware, such as RFID tags, weight sensors, shelf load cells, or product-slot instrumentation; the system still uses two camera sensors. Conventional snapshot-difference methods compare only a small number of frames at the beginning and end of a transaction and therefore cannot explicitly represent intermediate product motion, such as pickup, return, inspection, occlusion, and shelf resettling. This paper proposes ZAB-Fusion, a dual-camera edge sensing framework with zone-aware multi-object tracking for sensorless smart vending cabinets. The framework combines a YOLO11-seg and RT-DETR detection ensemble with ByteTrack temporal association, projects product tracks into a three-zone vertical cabinet model, interprets compressed zone sequences using a finite-state event classifier, and integrates camera-specific event streams through an evidence-gated cross-camera fusion rule. The proposed method was evaluated on 220 in-service vending transactions containing 227 ground-truth TAKEN events and 87 RETURNED events across seven product classes. Compared with the snapshot-difference baseline, ZAB-Fusion improved recall from 0.665 to 0.925 and F1-score from 0.780 to 0.944, while maintaining a high precision of 0.963. At the transaction level, exact receipt accuracy increased from 0.645 to 0.900. Runtime analysis on an Intel N100 CPU-only edge device showed an average processing latency of 562 ms per transaction under the selected-frame inference protocol. The zone classification, finite-state event interpretation, and evidence-gated cross-camera fusion stages required only 3 ms in total. These results demonstrate that explicit motion semantics and auditable cross-camera evidence gating can improve sensorless retail transaction level recognition in sensorless smart vending cabinets without adding auxiliary product-level sensing hardware.
Authors
- Heung Seok Jeon (ORCID: https://orcid.org/0000-0003-3672-9568)
- Abror Shavkatovich Buriboev (ORCID: https://orcid.org/0000-0001-8024-6200)
- Abbos Abduvaytov
- Cheolwon Lee
- Farkhat Rajabov (ORCID: https://orcid.org/0000-0003-0917-945X)
- Su-Mi Shin
- Shavkat Buriboev
- Giyosjon Sharipov
- Rustem Allanyazov
- Aziza Akhmedova
- Ruzimboy Sobirov
Institutions
- Gachon University (KR)
- Samarkand State University named after Sharof Rashidov (UZ)
- Namangan State University (UZ)
- Tashkent University of Information Technology (UZ)
- Konkuk University (KR)
- Samarkand Institute of Economics and Service (UZ)
- Tashkent Institute of Irrigation and Agricultural Mechanization Engineers (UZ)
- Namangan Engineering Pedagogical Institute (UZ)
- Westminster International University in Tashkent (UZ)
- Korea Institute of Science & Technology Information (KR)
Publication Details
- Journal
- Sensors
- Published
- 2026-08-17
- DOI
- https://doi.org/10.3390/s26165213
- Primary Topic
- RFID technology advancements
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Research Foundation of Korea