GEN-CVCI: Optimization of the HOI Detection Model Based on GEN
Human-Object Interaction (HOI) detection aims to identify people, objects, and their interactions in images, typically represented as <human bounding box, object bounding box, object category, action category>. The proposed model, GEN-CVCI, enhances the baseline GEN-VLKT through three key improvements. First, to strengthen visual feature extraction, GEN-CVCI integrates the Convolutional Block Attention Module (CBAM) into the visual encoder, improving feature representation for humans and objects. Second, a new category query learning module is introduced before the interaction decoder to enhance logical reasoning. Third, for finer-grained interaction classification, the model combines outputs from the verb classifier and HOI classifier to refine predictions. On the V-COCO and HICO-DET benchmarks, GEN-CVCI achieves mAP improvements of 2.11 and 2.3 percentage points, respectively, over GEN-VLKT.
Authors
- Ke Yang (ORCID: https://orcid.org/0000-0001-8617-3161)
Institutions
- Shanghai University of Engineering Science (CN)
Publication Details
- Published
- 2025-05-23
- DOI
- https://doi.org/10.1109/cvidl65390.2025.11086035
- Primary Topic
- Explainable Artificial Intelligence (XAI)
- Type
- article
- Field-Weighted Citation Impact
- 0.00