Occluded Object Classification With mmWave MIMO Radar IQ Signals Using Dual-Stream Convolutional Neural Networks

The ability of mmWave radar to penetrate lightweight materials and provide non-visual insights into obscured areas represents a significant advantage over camera or LiDAR sensors. This capability enables mmWave radar to detect humans behind thin walls or identify occluded objects stored within luggage or packages. The latter capability is particularly valuable in industrial, logistics, and manufacturing applications, where the ability to "look inside the box without opening it" can greatly enhance efficiency and security. However, the current state-of-the-art in these applications relies on expensive custom-built large antenna array imaging scanners, coupled with image-based object detection algorithms, to detect and classify occluded or concealed objects. To address this challenge more efficiently, we propose a lightweight classification approach for detecting various occluded objects inside a cardboard box. We employ a standard off-the-shelf mmWave 4D FMCW imaging radar. This is combined with a deep learning-based classification method in form of a dual-stream CNN approach to process complex IQ radar signals. This approach reaches in our experiments an overall accuracy of 95.15% on average over a collection of ten different concealed objects.