GEN-CVCI: Optimization of the HOI Detection Model Based on GEN

Human-Object Interaction (HOI) detection aims to identify people, objects, and their interactions in images, typically represented as <human bounding box, object bounding box, object category, action category>. The proposed model, GEN-CVCI, enhances the baseline GEN-VLKT through three key improvements. First, to strengthen visual feature extraction, GEN-CVCI integrates the Convolutional Block Attention Module (CBAM) into the visual encoder, improving feature representation for humans and objects. Second, a new category query learning module is introduced before the interaction decoder to enhance logical reasoning. Third, for finer-grained interaction classification, the model combines outputs from the verb classifier and HOI classifier to refine predictions. On the V-COCO and HICO-DET benchmarks, GEN-CVCI achieves mAP improvements of 2.11 and 2.3 percentage points, respectively, over GEN-VLKT.

Authors

Institutions

Publication Details

Published
2025-05-23
DOI
https://doi.org/10.1109/cvidl65390.2025.11086035
Primary Topic
Explainable Artificial Intelligence (XAI)
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

GEN-CVCI: Optimization of the HOI Detection Model Based on GEN

Ke Yang
Explainable Artificial Intelligence (XAI)
article

GEN-CVCI: Optimization of the HOI Detection Model Based on GEN

Ke Yang
article en

Abstract

Human-Object Interaction (HOI) detection aims to identify people, objects, and their interactions in images, typically represented as <human bounding box, object bounding box, object category, action category>. The proposed model, GEN-CVCI, enhances the baseline GEN-VLKT through three key improvements. First, to strengthen visual feature extraction, GEN-CVCI integrates the Convolutional Block Attention Module (CBAM) into the visual encoder, improving feature representation for humans and objects. Second, a new category query learning module is introduced before the interaction decoder to enhance logical reasoning. Third, for finer-grained interaction classification, the model combines outputs from the verb classifier and HOI classifier to refine predictions. On the V-COCO and HICO-DET benchmarks, GEN-CVCI achieves mAP improvements of 2.11 and 2.3 percentage points, respectively, over GEN-VLKT.

Shanghai University of Engineering Science (CN)
Openalex Percentile: Top 91%
Explainable Artificial Intelligence (XAI)
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.