Research of adaptive three kinds of education robot based on large model framework

This article aims to design a three kinds real-time binocular vision detection system based on the ppdet target detection large model of the Paddlepaddle framework to improve the recognition capabilities and efficiency of smart classroom education robots. Firstly, an in-depth study was conducted on the theories related to binocular stereo vision, including camera models, binocular ranging principles, binocular camera calibration stereo correction, etc. Then it introduces the selection of hardware platform, binocular vision system image preprocessing, FPGA acceleration of stereo matching algorithm, and real-time comparison of stereo vision implementation. Next, the expert experience was used to label the face status of teachers and students in the smart classroom into three categories, and the processed data was trained based on the ppdet target detection large model, and the model was tested. Finally, experimental verification was conducted through a real-life application scenario of a binocular patrol robot. Experimental results show that the binocular vision system module of the smart classroom inspection robot can effectively reshape visual data to improve target recognition accuracy.