Graph Enhanced Multi-Modal Network of 4-D Radar-Camera Fusion for Perception in Autonomous Systems

Modern autonomous systems rely on heterogeneous sensing modalities—including vision sensors, millimeter-wave radar, and LiDAR—yet each individual sensor exhibits characteristic failure modes in challenging real-world conditions. While LiDAR-vision co-processing has received extensive attention, the synergistic potential of 4D radar paired with monocular optics remains comparatively unexplored. To fill this gap, we develop a graph-enhanced multi-modal architecture that jointly leverages sparse 4D radar returns and high-resolution camera imagery for scene-level 3D perception. The proposed system is organized around four tightly coupled processing stages: (i) an image-guided point densification scheme (SAA) that augments sparse radar clouds with camera-derived pseudo measurements; (ii) a pose-invariant cross-modal fusion layer that harmonizes enriched radar features with image descriptors and object saliency maps; (iii) a dynamic hypergraph assembly stage that captures higher-order inter-object and cross-sensor dependencies; and (iv) a HyperGCN inference module that regresses 3D bounding parameters and class labels on the resulting relational graph. Integrating the temporal velocity cues native to radar with the rich appearance information from cameras, the system delivers reliable perception under diverse environmental conditions. On the View-of-Delft (VOD) evaluation suite, the proposed model records an mAP of 69.3 and mAOS of 59.8. A systematic ablation further quantifies how geometric invariance—across translation, rotation, and scale transformations—individually affects end-to-end detection fidelity.