Image Segmentation Based on Convolutional R-CNN

With the development of artificial intelligence, probabilistic graphical models, and machine learning, computer vision has made significant breakthroughs, making image instance segmentation a new challenging task in computer vision following semantic segmentation and object detection. Compared to traditional computer vision tasks, instance segmentation not only requires distinguishing different objects in an image but also differentiating between instances of these objects, making the task highly comprehensive. Many algorithms have been developed to solve instance segmentation tasks, among which the Mask Region-based Convolutional Neural Network (Mask R-CNN) algorithm is relatively mature. However, there is still room for improvement in Mask R-CNN, especially in terms of segmentation boundaries where significant errors exist. To solve the issue of blurred instance segmentation boundaries, this paper explores a method combining Mask R-CNN with Conditional Random Fields. This method employs convolutional conditional random fields and fully connected conditional random fields in the mask branch to optimize the further segmentation of candidate regions, resulting in more precise boundaries. Experimental results show that compared to the original algorithm, these methods increase the mAP value by 0.6% and 3%, respectively. In the comparison of segmentation results for targets of different scales, the improvements with Mask R-CNN-ConvCRF are particularly notable for medium and large-scale targets, with increases of 4% and 5.1%, respectively.

Authors

Institutions

Publication Details

Published
2024-11-22
DOI
https://doi.org/10.1109/icicml63543.2024.10957796
Primary Topic
Optical Systems and Laser Technology
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Image Segmentation Based on Convolutional R-CNN

Ruiqing Ni, Liyun Qin, Yao Ge, Yuanfei He
Optical Systems and Laser Technology
article

Image Segmentation Based on Convolutional R-CNN

Ruiqing Ni, Liyun Qin, Yao Ge, Yuanfei He
article en

Abstract

With the development of artificial intelligence, probabilistic graphical models, and machine learning, computer vision has made significant breakthroughs, making image instance segmentation a new challenging task in computer vision following semantic segmentation and object detection. Compared to traditional computer vision tasks, instance segmentation not only requires distinguishing different objects in an image but also differentiating between instances of these objects, making the task highly comprehensive. Many algorithms have been developed to solve instance segmentation tasks, among which the Mask Region-based Convolutional Neural Network (Mask R-CNN) algorithm is relatively mature. However, there is still room for improvement in Mask R-CNN, especially in terms of segmentation boundaries where significant errors exist. To solve the issue of blurred instance segmentation boundaries, this paper explores a method combining Mask R-CNN with Conditional Random Fields. This method employs convolutional conditional random fields and fully connected conditional random fields in the mask branch to optimize the further segmentation of candidate regions, resulting in more precise boundaries. Experimental results show that compared to the original algorithm, these methods increase the mAP value by 0.6% and 3%, respectively. In the comparison of segmentation results for targets of different scales, the improvements with Mask R-CNN-ConvCRF are particularly notable for medium and large-scale targets, with increases of 4% and 5.1%, respectively.

North China University of Technology (CN)
Openalex Percentile: Top 73%
Optical Systems and Laser Technology
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.