Multifeature fusion embedding network for unbiased scene graph generation

Scene Graph Generation (SGG) aims to bridge images and text. Addressing the issues of data distribution imbalance and long-tail effects in existing SGG methods, we propose a new Multi-feature Fusion Embedding Network(MFE-Net). This network optimizes relationship prediction through multi-level visual feature fusion and hard-constrained semantic feature classification, aiming to reduce inter-class confusion and strengthen intra-class consistency. Experiments on the Visual Genome dataset demonstrate that our model significantly enhances the accuracy of relationship recognition, achieving a new level of performance. The research not only optimizes SGG performance but also provides new strategies for addressing classification problems involving easily confused relationships.

Authors

Institutions

Publication Details

Published
2024-10-03
DOI
https://doi.org/10.1117/12.3048382
Primary Topic
Generative Adversarial Networks and Image Synthesis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Multifeature fusion embedding network for unbiased scene graph generation

Wei Chen, Shuo Li, Jun Zhang, Shengze Hu et al.
Generative Adversarial Networks and Image Synthesis
article

Multifeature fusion embedding network for unbiased scene graph generation

Wei Chen, Shuo Li, Jun Zhang, Shengze Hu, Ting He
article en

Abstract

Scene Graph Generation (SGG) aims to bridge images and text. Addressing the issues of data distribution imbalance and long-tail effects in existing SGG methods, we propose a new Multi-feature Fusion Embedding Network(MFE-Net). This network optimizes relationship prediction through multi-level visual feature fusion and hard-constrained semantic feature classification, aiming to reduce inter-class confusion and strengthen intra-class consistency. Experiments on the Visual Genome dataset demonstrate that our model significantly enhances the accuracy of relationship recognition, achieving a new level of performance. The research not only optimizes SGG performance but also provides new strategies for addressing classification problems involving easily confused relationships.

National University of Defense Technology (CN)
Openalex Percentile: Top 83%
Generative Adversarial Networks and Image Synthesis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.