The Research on Green Screen Video Segmentation Based on Multi-scale Deep Learning Techniques

As a key branch of artificial intelligence and machine learning, deep learning technology has continuously developed and improved, leading to significant progress and widespread applications in the field of video segmentation. However, within this technological wave, traditional green screen video segmentation methods seem to have been marginalized, and related research has received relatively little attention. To address the shortcomings of existing research, this approach proposes a new green screen video segmentation method that combines traditional chroma keying techniques with the lightweight deep learning network MobileNetV4, aiming to achieve efficient and accurate segmentation results. The chroma key module generates a rough mask, providing auxiliary information for subsequent feature extraction, while feature fusion and a recurrent decoder module enhance the consistency and detail retention between video frames. Experimental results demonstrate that this method performs excellently on both the VideoMatte240K dataset and a self-constructed dataset, effectively improving the precision and efficiency of video segmentation. The region similarity J reached 98%, and the contour accuracy F reached 94%, surpassing the average value Avg(J&F) of the second-ranked MODNet algorithm by 9.6%.

Authors

Institutions

Publication Details

Published
2024-12-20
DOI
https://doi.org/10.1145/3718441.3718456
Primary Topic
Video Surveillance and Tracking Methods
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

The Research on Green Screen Video Segmentation Based on Multi-scale Deep Learning Techniques

Shengling Geng, Mingquan Zhou, XiangTao Dong, Zhiguo Wang
Video Surveillance and Tracking Methods
article

The Research on Green Screen Video Segmentation Based on Multi-scale Deep Learning Techniques

Shengling Geng, Mingquan Zhou, XiangTao Dong, Zhiguo Wang
article en

Abstract

As a key branch of artificial intelligence and machine learning, deep learning technology has continuously developed and improved, leading to significant progress and widespread applications in the field of video segmentation. However, within this technological wave, traditional green screen video segmentation methods seem to have been marginalized, and related research has received relatively little attention. To address the shortcomings of existing research, this approach proposes a new green screen video segmentation method that combines traditional chroma keying techniques with the lightweight deep learning network MobileNetV4, aiming to achieve efficient and accurate segmentation results. The chroma key module generates a rough mask, providing auxiliary information for subsequent feature extraction, while feature fusion and a recurrent decoder module enhance the consistency and detail retention between video frames. Experimental results demonstrate that this method performs excellently on both the VideoMatte240K dataset and a self-constructed dataset, effectively improving the precision and efficiency of video segmentation. The region similarity J reached 98%, and the contour accuracy F reached 94%, surpassing the average value Avg(J&F) of the second-ranked MODNet algorithm by 9.6%.

Qinghai Normal University (CN), Beijing Normal University (CN)
Openalex Percentile: Top 70%
Video Surveillance and Tracking Methods
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.