Approach to Deep-learning-based Visual Relationship Detection for Scene Analysis

The paper is focused on the implementation of a deep-learning-based visual relationship detection system for scene analysis.Initially, the system employs convolutional neural networks (CNNs) for precise object detection and localization, accurately capturing detailed information about the objects in the scene.Following this, the system applies the vision transformer model to infer relationships between objects, enabling detailed analysis, interpretation of spatial layouts, and understanding of behavioral interactions among objects within the scene.This process allows the system to gain a profound understanding of the relationships and interaction patterns among the objects.Furthermore, the system integrates an intuitive and feature-rich user interface to display detailed relationships among objects and the model's inference outcomes.We not only conduct scene analysis but also provide functionality for users to select two distinct subjects for visual relationship detection.Users can choose two subjects of interest to explore their relationships with other objects in the same scene.Through this selection capability, the system analyzes the selected subjects while excluding results that do not meet specified criteria.This functionality enables users to precisely control the analysis direction, ensuring that the results align with their expectations and requirements effectively.

Authors

Institutions

Publication Details

Journal
Sensors and Materials
Published
2025-03-28
DOI
https://doi.org/10.18494/sam5220
Primary Topic
Video Surveillance and Tracking Methods
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Approach to Deep-learning-based Visual Relationship Detection for Scene Analysis

Ming-Yuan Shieh, Neng‐Sheng Pai, Peichen Wu
Sensors and Materials
Video Surveillance and Tracking Methods
article

Approach to Deep-learning-based Visual Relationship Detection for Scene Analysis

Ming-Yuan Shieh, Neng‐Sheng Pai, Peichen Wu
article en

Abstract

The paper is focused on the implementation of a deep-learning-based visual relationship detection system for scene analysis.Initially, the system employs convolutional neural networks (CNNs) for precise object detection and localization, accurately capturing detailed information about the objects in the scene.Following this, the system applies the vision transformer model to infer relationships between objects, enabling detailed analysis, interpretation of spatial layouts, and understanding of behavioral interactions among objects within the scene.This process allows the system to gain a profound understanding of the relationships and interaction patterns among the objects.Furthermore, the system integrates an intuitive and feature-rich user interface to display detailed relationships among objects and the model's inference outcomes.We not only conduct scene analysis but also provide functionality for users to select two distinct subjects for visual relationship detection.Users can choose two subjects of interest to explore their relationships with other objects in the same scene.Through this selection capability, the system analyzes the selected subjects while excluding results that do not meet specified criteria.This functionality enables users to precisely control the analysis direction, ensuring that the results align with their expectations and requirements effectively.

Sensors and MaterialsVol. 37(3)
National Chin-Yi University of Technology (TW)
National Science and Technology Council
Openalex Percentile: Top 95%
Video Surveillance and Tracking Methods
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Approach to Deep-learning-based Visual Relationship Detection for Scene Analysis — Ming-Yuan Shieh, Neng‐Sheng Pai, et al. · Sensors and Materials (2025) | TGRS Research Map | TGRS