Research on visual navigation scene analysis based on CV question and answer and attention mechanism

With the rapid development of artificial intelligence technology, computer visual question and answer technology as well as scene description analysis technology are becoming more and more mature, and have been widely used in various fields of society. However, the current visual navigation scene analysis often suffers from problems such as incomplete scene description and inaccurate visual question and answer. A method combining the attention mechanism and visual Q&A is proposed, and the method is applied to navigation scene analysis to construct a visual navigation scene analysis model based on visual Q&A and attention mechanism. The model is subjected to performance comparison experiments using the similarity between the generated answer and the reference answer and the accuracy rate of scene description as the indexes, and the experimental results show that the average similarity and the average accuracy rate of the model are 0.598 and 87.6%, respectively. The above results show that the performance of the model is significantly better than the comparison model and is effective.

Authors

Institutions

Publication Details

Published
2024-10-03
DOI
https://doi.org/10.1117/12.3048392
Primary Topic
Video Analysis and Summarization
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Research on visual navigation scene analysis based on CV question and answer and attention mechanism

HaoTong Wang, Yulang Yuan
Video Analysis and Summarization
article

Research on visual navigation scene analysis based on CV question and answer and attention mechanism

HaoTong Wang, Yulang Yuan
article en

Abstract

With the rapid development of artificial intelligence technology, computer visual question and answer technology as well as scene description analysis technology are becoming more and more mature, and have been widely used in various fields of society. However, the current visual navigation scene analysis often suffers from problems such as incomplete scene description and inaccurate visual question and answer. A method combining the attention mechanism and visual Q&A is proposed, and the method is applied to navigation scene analysis to construct a visual navigation scene analysis model based on visual Q&A and attention mechanism. The model is subjected to performance comparison experiments using the similarity between the generated answer and the reference answer and the accuracy rate of scene description as the indexes, and the experimental results show that the average similarity and the average accuracy rate of the model are 0.598 and 87.6%, respectively. The above results show that the performance of the model is significantly better than the comparison model and is effective.

Dalian Jiaotong University (CN)
Openalex Percentile: Top 83%
Video Analysis and Summarization
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.