Enhancing Transparent Object Matting Using Predicted Definite Foreground and Background

Natural image matting is a widely used image processing technique that extracts foreground by predicting the alpha values of the unknown region based on the alpha values of the known foreground and background regions. However, existing image matting methods may not yield the most optimal results when applied to images containing transparent objects because the known foreground region is small or even absent. To address this shortcoming, in this paper, we propose a novel method named Transparent Object Matting using Predicted Definite Foreground and Background (TOM-PDFB), which can explore and utilize the definite foreground and background in the unknown region. For this purpose, a newly developed foreground-background confidence estimator is applied to predict the confidence level of the definite foreground and the definite background, thus providing the priors required for transparent object matting. Next, foreground-background guided progressive refinement network developed as a part of this work is adopted to incorporate the estimated definite foreground and background into the alpha matte refinement process. Extensive experimental results demonstrate that the TOM-PDFB outperforms state-of-the-art methods when applied to transparent objects. Project page: <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/yihuiliang/TOM-PDFB</uri>.

Authors

Institutions

Publication Details

Journal
IEEE Transactions on Circuits and Systems for Video Technology
Published
2024-08-30
DOI
https://doi.org/10.1109/tcsvt.2024.3452512
Citations
3
Primary Topic
Image Enhancement Techniques
Type
article
Field-Weighted Citation Impact
0.75

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Enhancing Transparent Object Matting Using Predicted Definite Foreground and Background

Guisong Liu, Qian Fu, Kun Zou, Yihui Liang et al.
3 citations
IEEE Transactions on Circuits and Systems for Video Technology
Image Enhancement Techniques
0.75
article

Enhancing Transparent Object Matting Using Predicted Definite Foreground and Background

Guisong Liu, Qian Fu, Kun Zou, Yihui Liang, Han Huang
article en
3 citations

Abstract

Natural image matting is a widely used image processing technique that extracts foreground by predicting the alpha values of the unknown region based on the alpha values of the known foreground and background regions. However, existing image matting methods may not yield the most optimal results when applied to images containing transparent objects because the known foreground region is small or even absent. To address this shortcoming, in this paper, we propose a novel method named Transparent Object Matting using Predicted Definite Foreground and Background (TOM-PDFB), which can explore and utilize the definite foreground and background in the unknown region. For this purpose, a newly developed foreground-background confidence estimator is applied to predict the confidence level of the definite foreground and the definite background, thus providing the priors required for transparent object matting. Next, foreground-background guided progressive refinement network developed as a part of this work is adopted to incorporate the estimated definite foreground and background into the alpha matte refinement process. Extensive experimental results demonstrate that the TOM-PDFB outperforms state-of-the-art methods when applied to transparent objects. Project page: <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/yihuiliang/TOM-PDFB</uri>.

IEEE Transactions on Circuits and Systems for Video TechnologyVol. 35(1)
University of Electronic Science and Technology of China (CN), Southwestern University of Finance and Economics (CN), South China University of Technology (CN)
National Natural Science Foundation of China, Natural Science Foundation of Guangdong Province, Natural Science Foundation of Sichuan Province, Science and Technology Planning Project of Guangdong Province, Basic and Applied Basic Research Foundation of Guangdong Province
Climate action
Openalex Percentile: Top 28%
Image Enhancement Techniques
0.75
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.