A Basic Study on Identification of Surgical Steel Instruments Using Ortho-image with Dimensional Information Obtained by RGB-D Camera

In this study, to realize a simple identification of surgical steel instruments, we proposed a method to detect surgical steel instruments using Faster R-CNN on ortho-images of surgical steel instruments acquired with an RGB-D camera, and furthermore, to identify surgical steel instruments based on their dimensional information. In the proposed method, ortho-images are generated by orthographic transformation of 3D point clouds acquired using Intel REALSENSE DEPTH CAMERA D435i. A faster R-CNN object detector was applied to the ortho-image to detect surgical steel instruments. Since the ortho-image of the proposed method contains dimensional information, the area value of the region containing the surgical steel instrument can be easily calculated, and the surgical steel instrument can be identified without image scale correction.