Research on visual navigation scene analysis based on CV question and answer and attention mechanism
With the rapid development of artificial intelligence technology, computer visual question and answer technology as well as scene description analysis technology are becoming more and more mature, and have been widely used in various fields of society. However, the current visual navigation scene analysis often suffers from problems such as incomplete scene description and inaccurate visual question and answer. A method combining the attention mechanism and visual Q&A is proposed, and the method is applied to navigation scene analysis to construct a visual navigation scene analysis model based on visual Q&A and attention mechanism. The model is subjected to performance comparison experiments using the similarity between the generated answer and the reference answer and the accuracy rate of scene description as the indexes, and the experimental results show that the average similarity and the average accuracy rate of the model are 0.598 and 87.6%, respectively. The above results show that the performance of the model is significantly better than the comparison model and is effective.
Authors
- HaoTong Wang
- Yulang Yuan
Institutions
- Dalian Jiaotong University (CN)
Publication Details
- Published
- 2024-10-03
- DOI
- https://doi.org/10.1117/12.3048392
- Primary Topic
- Video Analysis and Summarization
- Type
- article
- Field-Weighted Citation Impact
- 0.00