Less is more: Efficient Scene Graph Generation with reparameterization

Scene Graph Generation (SGG) aims to identify objects and their relationships in visual scenes but faces two key challenges: high computational overhead, particularly for real-time applications, and the long-tailed distribution of predicates, which biases models toward frequent relationships. To address these challenges, we propose Reparams-SGG, a lightweight and efficient network architecture composed of multi-path residual blocks. This architecture reduces computational overhead by leveraging a reparameterization strategy that minimizes sequential and parallel processing, making it highly efficient during inference. Moreover, we introduce a dynamic focal loss that dynamically adjusts the temperature scale during training to focus learning on rare predicates, promoting progressively unbiased learning. Additionally, we propose a dynamic distribution loss, compensating for learning limitations solely from one-hot distributions under data imbalance conditions. We evaluate our method on the widely-used Visual Genome and the recent PSG dataset. Reparams-SGG achieves competitive performance with significantly fewer parameters than state-of-the-art models, demonstrating its efficiency and suitability for deployment in resource-constrained environments.

Authors

Institutions

Publication Details

Published
2025-03-12
DOI
https://doi.org/10.1109/icassp49660.2025.10888396
Primary Topic
Multimodal Machine Learning Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Less is more: Efficient Scene Graph Generation with reparameterization

Hanseok Ko, Jonghwan Hong, Bonhwa Ku, Seonghyeok Noh
Multimodal Machine Learning Applications
article

Less is more: Efficient Scene Graph Generation with reparameterization

Hanseok Ko, Jonghwan Hong, Bonhwa Ku, Seonghyeok Noh
article en

Abstract

Scene Graph Generation (SGG) aims to identify objects and their relationships in visual scenes but faces two key challenges: high computational overhead, particularly for real-time applications, and the long-tailed distribution of predicates, which biases models toward frequent relationships. To address these challenges, we propose Reparams-SGG, a lightweight and efficient network architecture composed of multi-path residual blocks. This architecture reduces computational overhead by leveraging a reparameterization strategy that minimizes sequential and parallel processing, making it highly efficient during inference. Moreover, we introduce a dynamic focal loss that dynamically adjusts the temperature scale during training to focus learning on rare predicates, promoting progressively unbiased learning. Additionally, we propose a dynamic distribution loss, compensating for learning limitations solely from one-hot distributions under data imbalance conditions. We evaluate our method on the widely-used Visual Genome and the recent PSG dataset. Reparams-SGG achieves competitive performance with significantly fewer parameters than state-of-the-art models, demonstrating its efficiency and suitability for deployment in resource-constrained environments.

Korea University (KR)
Openalex Percentile: Top 97%
Multimodal Machine Learning Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Less is more: Efficient Scene Graph Generation with reparameterization — Hanseok Ko, Jonghwan Hong, et al. · (2025) | TGRS Research Map | TGRS