Closing the Domain Gap in Manga Colorization via Aligned Paired Dataset

This paper addresses the challenge of artwork colorization by proposing a benchmark for manga colorization using real black-and-white and colorized image pairs. Color images are widely recognized for their ability to capture attention and improve memory retention, yet the manual process of colorization is labor-intensive. Deep learning methods for supervised image-to-image translation offer a promising solution, relying on aligned pairs of black-and-white and color images for training. However, these pairs are often generated synthetically, introducing a domain gap that limits model performance. To address this, we explore the use of real data, proposing a method for creating such datasets. Our benchmarks reveal that models trained on real data significantly outperform those trained on synthetic pairs. Furthermore, we present a pipeline for text removal and panel segmentation, streamlining the comic colorization process. These contributions aim to enhance the generalization and applicability of deep learning models for artwork colorization.

Authors

Institutions

Publication Details

Published
2025-02-26
DOI
https://doi.org/10.1109/wacv61041.2025.00545
Primary Topic
Color perception and design
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Closing the Domain Gap in Manga Colorization via Aligned Paired Dataset

Maksim Golyadkin, Ilya Makarov, Ianis Plevokas
Color perception and design
article

Closing the Domain Gap in Manga Colorization via Aligned Paired Dataset

Maksim Golyadkin, Ilya Makarov, Ianis Plevokas
article en

Abstract

This paper addresses the challenge of artwork colorization by proposing a benchmark for manga colorization using real black-and-white and colorized image pairs. Color images are widely recognized for their ability to capture attention and improve memory retention, yet the manual process of colorization is labor-intensive. Deep learning methods for supervised image-to-image translation offer a promising solution, relying on aligned pairs of black-and-white and color images for training. However, these pairs are often generated synthetically, introducing a domain gap that limits model performance. To address this, we explore the use of real data, proposing a method for creating such datasets. Our benchmarks reveal that models trained on real data significantly outperform those trained on synthetic pairs. Furthermore, we present a pipeline for text removal and panel segmentation, streamlining the comic colorization process. These contributions aim to enhance the generalization and applicability of deep learning models for artwork colorization.

National Research University Higher School of Economics (RU)
National Research University Higher School of Economics, Hopkins Population Center, Johns Hopkins University
Openalex Percentile: Top 92%
Color perception and design
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.