Relic2Contour: Salient contour detection in relics using semi-supervised generative adversarial networks based on knowledge sharing

Line drawing, characterized by its unique techniques and profound cultural heritage, presents the boundless charm of traditional Chinese art. To gain deeper insights into the esthetic styles of different dynasties and the essence of various painting schools, employing digital methods to extract the contours of relics is essential. Although existing digital line drawing extraction methods can enhance efficiency, the surfaces of relics often exhibit pigment mottling, cracks, and other diseases. These interfering elements tend to intertwine with the contours, increasing the difficulty of line extraction. For this task, we propose a knowledge-sharing strategy-based approach to learn the mapping from relic images to contours in a semi-supervised manner. We integrate a supervised learning branch into the unsupervised image translation framework that utilizes undamaged relic images paired with corresponding noise-free contours for training. By sharing the generator, the noise-free contour style learned by the supervised branch is infused into the unsupervised branch, effectively suppressing diseases. Furthermore, we achieve complementary texture features through two independent streams: the contour generation flow (CGF) and the auxiliary gradient flow (AGF), each designed with separate GAN architectures. To better capture relic details, we introduce the coordinate attention transfer (CAT) module, which adaptively transfers features from AGF to the corresponding dimensions of CGF by learning spatial orientation and positional weights. Finally, the bidirectional gated transposed fusion (Bi-GTF) module employs two soft gates to regulate the information fusion between CGF and AGF, guiding CGF to focus on the shape and intricate details of the relics. In our experiments, we conducted both quantitative and qualitative comparisons with six state-of-the-art algorithms, analyzing the impact of gradient-guided feature transfer and the generalization of the semi-supervised framework. The results demonstrate that Relic2Contour generates rich, clear, and high-quality contour images from relics across various styles.

Authors

Institutions

Publication Details

Journal
npj Heritage Science
Published
2025-03-24
DOI
https://doi.org/10.1038/s40494-025-01606-0
Citations
1
Primary Topic
Image Processing and 3D Reconstruction
Type
article
Field-Weighted Citation Impact
1.28

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Relic2Contour: Salient contour detection in relics using semi-supervised generative adversarial networks based on knowledge sharing

Xianlin Peng, Qunxi Zhang, Jinye Peng, Shuyi Qu et al.
1 citations
npj Heritage Science
Image Processing and 3D Reconstruction
1.28
article

Relic2Contour: Salient contour detection in relics using semi-supervised generative adversarial networks based on knowledge sharing

Xianlin Peng, Qunxi Zhang, Jinye Peng, Shuyi Qu, Yirong Ma, Jun Wang, Zhe Yu, Qingqing Kang, Shenglin Peng
article en
1 citations

Abstract

Line drawing, characterized by its unique techniques and profound cultural heritage, presents the boundless charm of traditional Chinese art. To gain deeper insights into the esthetic styles of different dynasties and the essence of various painting schools, employing digital methods to extract the contours of relics is essential. Although existing digital line drawing extraction methods can enhance efficiency, the surfaces of relics often exhibit pigment mottling, cracks, and other diseases. These interfering elements tend to intertwine with the contours, increasing the difficulty of line extraction. For this task, we propose a knowledge-sharing strategy-based approach to learn the mapping from relic images to contours in a semi-supervised manner. We integrate a supervised learning branch into the unsupervised image translation framework that utilizes undamaged relic images paired with corresponding noise-free contours for training. By sharing the generator, the noise-free contour style learned by the supervised branch is infused into the unsupervised branch, effectively suppressing diseases. Furthermore, we achieve complementary texture features through two independent streams: the contour generation flow (CGF) and the auxiliary gradient flow (AGF), each designed with separate GAN architectures. To better capture relic details, we introduce the coordinate attention transfer (CAT) module, which adaptively transfers features from AGF to the corresponding dimensions of CGF by learning spatial orientation and positional weights. Finally, the bidirectional gated transposed fusion (Bi-GTF) module employs two soft gates to regulate the information fusion between CGF and AGF, guiding CGF to focus on the shape and intricate details of the relics. In our experiments, we conducted both quantitative and qualitative comparisons with six state-of-the-art algorithms, analyzing the impact of gradient-guided feature transfer and the generalization of the semi-supervised framework. The results demonstrate that Relic2Contour generates rich, clear, and high-quality contour images from relics across various styles.

npj Heritage ScienceVol. 13(1)
State Administration of Cultural Heritage (CN), Northwest University (CN), Shaanxi History Museum (CN)
National Natural Science Foundation of China, Key Research and Development Projects of Shaanxi Province
Climate action
Openalex Percentile: Top 22%
Image Processing and 3D Reconstruction
1.28
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.