Algorithm of Robot Visual Perception and Environment Interaction Based on Deep Learning

With the rapid development of science and technology, the visual perception and environmental interaction of robot technology in complex and changeable environment has become a research hotspot. In this paper, an algorithm of robot visual perception and environment interaction based on deep learning is proposed, aiming at solving the limitations of traditional methods in dealing with complex and dynamic scenes. The algorithm uses pre-trained ResNet as feature extractor, combined with YOLO7 target detection algorithm, and realizes fast and accurate detection and recognition of objects in the image. The detected targets are classified by softmax function, and the scene is deeply understood by using conditional random field (CRF) technology, which improves the robot’s overall ability to grasp the environment. In the aspect of path planning, the algorithm uses reinforcement learning technology and continuously optimizes the decision-making strategy through Q-learning method, thus realizing the autonomous navigation and obstacle avoidance of the robot in the dynamic environment. Experimental results show that this algorithm has high accuracy and robustness in complex scenes such as multiple similar objects recognition, illumination change recognition and partial occlusion recognition, and the path planning accuracy is better than Dijkstra algorithm, and the overall performance is better than other deep learning algorithms (Faster R-CNN, SSD, YOLOv5). This study not only verifies the effectiveness of the robot visual perception and environment interaction algorithm based on deep learning, but also provides new ideas and methods for the future development of robot technology.

Authors

Institutions

Publication Details

Published
2024-08-14
DOI
https://doi.org/10.1109/peeec63877.2024.00197
Primary Topic
E-commerce and Technology Innovations
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Algorithm of Robot Visual Perception and Environment Interaction Based on Deep Learning

Boyang Zhang
E-commerce and Technology Innovations
article

Algorithm of Robot Visual Perception and Environment Interaction Based on Deep Learning

Boyang Zhang
article en

Abstract

With the rapid development of science and technology, the visual perception and environmental interaction of robot technology in complex and changeable environment has become a research hotspot. In this paper, an algorithm of robot visual perception and environment interaction based on deep learning is proposed, aiming at solving the limitations of traditional methods in dealing with complex and dynamic scenes. The algorithm uses pre-trained ResNet as feature extractor, combined with YOLO7 target detection algorithm, and realizes fast and accurate detection and recognition of objects in the image. The detected targets are classified by softmax function, and the scene is deeply understood by using conditional random field (CRF) technology, which improves the robot’s overall ability to grasp the environment. In the aspect of path planning, the algorithm uses reinforcement learning technology and continuously optimizes the decision-making strategy through Q-learning method, thus realizing the autonomous navigation and obstacle avoidance of the robot in the dynamic environment. Experimental results show that this algorithm has high accuracy and robustness in complex scenes such as multiple similar objects recognition, illumination change recognition and partial occlusion recognition, and the path planning accuracy is better than Dijkstra algorithm, and the overall performance is better than other deep learning algorithms (Faster R-CNN, SSD, YOLOv5). This study not only verifies the effectiveness of the robot visual perception and environment interaction algorithm based on deep learning, but also provides new ideas and methods for the future development of robot technology.

Nanjing University of Aeronautics and Astronautics (CN)
Climate action
Openalex Percentile: Top 52%
E-commerce and Technology Innovations
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.