Dual Graph Inference Network for Weakly Supervised Semantic Segmentation

Establishing global contextual relationships between objects is crucial for weakly supervised semantic segmentation (WSSS) tasks that lack pixel-level labels. Limited by the efficiency of convolutional operations in capturing long-range dependencies with a limited receptive field and to bridge the gap between image-level annotations and pixel-level labels, we propose a Dual Graph Reasoning Mapping (DGRM) module. When integrated into a convolutional network, it conducts contextual graph reasoning on both spatial and interaction spaces of visual features. The first component of this graph reasoning module involves incorporating commonsense knowledge extracted from an external knowledge base into visual features to promote global contextual reasoning for visual graphs. The second component focuses on reasoning in the projected interaction space, utilizing abstracted object class attributes from high-level visual features to establish dependencies among channels in a potential low-dimensional space. Moreover, to capture correspondences at different semantic levels, we model the feature maps in a pyramid-like structure for graph reasoning at various levels. Extensive experiments on popular datasets, such as PASCAL VOC 2012 and MS COCO 2014, demonstrate the superiority of our approach. Our code is provided at <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/JIA-ZHANG666/DGRM</uri>.