Interweaving Insights: High-Order Feature Interaction for Fine-Grained Visual Recognition

This paper presents a novel approach for Fine-Grained Visual Classification (FGVC) by exploring Graph Neural Networks (GNNs) to facilitate high-order feature interactions, with a specific focus on constructing both inter- and intra-region graphs. Unlike previous FGVC techniques that often isolate global and local features, our method combines both features seamlessly during learning via graphs. Inter-region graphs capture long-range dependencies to recognize global patterns, while intra-region graphs delve into finer details within specific regions of an object by exploring high-dimensional convolutional features. A key innovation is the use of shared GNNs with an attention mechanism coupled with the Approximate Personalized Propagation of Neural Predictions (APPNP) message-passing algorithm, enhancing information propagation efficiency for better discriminability and simplifying the model architecture for computational efficiency. Additionally, the introduction of residual connections improves performance and training stability. Comprehensive experiments showcase state-of-the-art results on benchmark FGVC datasets, affirming the efficacy of our approach. This work underscores the potential of GNN in modeling high-level feature interactions, distinguishing it from previous FGVC methods that typically focus on singular aspects of feature representation. Our source code is available at https://github.com/Arindam-1991/I2-HOFI.

Authors

Institutions

Publication Details

Journal
International Journal of Computer Vision
Published
2024-10-20
DOI
https://doi.org/10.1007/s11263-024-02260-y
Citations
16
Primary Topic
Advanced Neural Network Applications
Type
article
Field-Weighted Citation Impact
3.99

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Interweaving Insights: High-Order Feature Interaction for Fine-Grained Visual Recognition

Amr AbdelFatah Ahmed, Yonghuai Liu, Siddhardha Kedarisetty, Arindam Sikdar et al.
16 citations
International Journal of Computer Vision
Advanced Neural Network Applications
3.99
article

Interweaving Insights: High-Order Feature Interaction for Fine-Grained Visual Recognition

Amr AbdelFatah Ahmed, Yonghuai Liu, Siddhardha Kedarisetty, Arindam Sikdar, Ardhendu Behera, Yitian Zhao
article en
16 citations

Abstract

This paper presents a novel approach for Fine-Grained Visual Classification (FGVC) by exploring Graph Neural Networks (GNNs) to facilitate high-order feature interactions, with a specific focus on constructing both inter- and intra-region graphs. Unlike previous FGVC techniques that often isolate global and local features, our method combines both features seamlessly during learning via graphs. Inter-region graphs capture long-range dependencies to recognize global patterns, while intra-region graphs delve into finer details within specific regions of an object by exploring high-dimensional convolutional features. A key innovation is the use of shared GNNs with an attention mechanism coupled with the Approximate Personalized Propagation of Neural Predictions (APPNP) message-passing algorithm, enhancing information propagation efficiency for better discriminability and simplifying the model architecture for computational efficiency. Additionally, the introduction of residual connections improves performance and training stability. Comprehensive experiments showcase state-of-the-art results on benchmark FGVC datasets, affirming the efficacy of our approach. This work underscores the potential of GNN in modeling high-level feature interactions, distinguishing it from previous FGVC methods that typically focus on singular aspects of feature representation. Our source code is available at https://github.com/Arindam-1991/I2-HOFI.

International Journal of Computer VisionVol. 133(4)
Edge Hill University (GB), Technion – Israel Institute of Technology (IL), Chinese Academy of Sciences (CN), Ningbo Institute of Industrial Technology (CN)
Nvidia, UK Research and Innovation, Engineering and Physical Sciences Research Council
Reduced inequalities
Openalex Percentile: Top 5%
Advanced Neural Network Applications
3.99
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.