Enhanced Face Sketch Synthesis Through a Multistage GAN Framework with Hierarchical Discriminators and MobileNet Feature Extraction

Facial sketch synthesis is a crucial task in computer vision with applications in law enforcement, digital art, and human–computer interaction. Despite its importance, generating high-quality and realistic facial sketches from images remains challenging due to the difficulty in preserving fine-grained details and minimizing artifacts like blur. Existing methods often struggle to maintain a balance between global coherence and local detail enhancement, resulting in suboptimal sketch quality. In order to tackle these issues, we suggest a novel multistage Generative Adversarial Network (GAN) framework incorporating hierarchical discriminators and MobileNet-based feature extraction. The input facial image is divided into multiple local regions, such as the eyes, nose, and mouth, enabling the model to learn detailed features for each facial component. The framework is composed of three key modules. The Local Region Module synthesizes sketches for specific facial regions, ensuring accurate detail representation. The Mask Module utilizes a MobileNet architecture enhanced with Squeeze-and-Excitation (SE) blocks to extract robust features. It also calculates two custom loss functions, Mask_Structure (MS) loss and Mask_Feature (MF) loss, to improve sketch precision and detail preservation. The Adaptive Grasshopper Optimization (AGHO) algorithm is applied to fine-tune the parameters of the MobileNet model, thereby enhancing its performance and accuracy. Finally, the Fusion Module integrates outputs from local modules into a unified, realistic sketch. The proposed method achieved an accuracy of 96.82% on the CUHK dataset, 97.12% on the AR dataset, 98.84% on the XM2VTS dataset, and 98.62% on the CUFSF dataset, demonstrating its effectiveness across diverse benchmarks.

Authors

Institutions

Publication Details

Journal
International Journal of Image and Graphics
Published
2025-11-07
DOI
https://doi.org/10.1142/s0219467827500744
Primary Topic
Face recognition and analysis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Enhanced Face Sketch Synthesis Through a Multistage GAN Framework with Hierarchical Discriminators and MobileNet Feature Extraction

A. Velmurugan, Buddannagari Latha
International Journal of Image and Graphics
Face recognition and analysis
article

Enhanced Face Sketch Synthesis Through a Multistage GAN Framework with Hierarchical Discriminators and MobileNet Feature Extraction

A. Velmurugan, Buddannagari Latha
article en

Abstract

Facial sketch synthesis is a crucial task in computer vision with applications in law enforcement, digital art, and human–computer interaction. Despite its importance, generating high-quality and realistic facial sketches from images remains challenging due to the difficulty in preserving fine-grained details and minimizing artifacts like blur. Existing methods often struggle to maintain a balance between global coherence and local detail enhancement, resulting in suboptimal sketch quality. In order to tackle these issues, we suggest a novel multistage Generative Adversarial Network (GAN) framework incorporating hierarchical discriminators and MobileNet-based feature extraction. The input facial image is divided into multiple local regions, such as the eyes, nose, and mouth, enabling the model to learn detailed features for each facial component. The framework is composed of three key modules. The Local Region Module synthesizes sketches for specific facial regions, ensuring accurate detail representation. The Mask Module utilizes a MobileNet architecture enhanced with Squeeze-and-Excitation (SE) blocks to extract robust features. It also calculates two custom loss functions, Mask_Structure (MS) loss and Mask_Feature (MF) loss, to improve sketch precision and detail preservation. The Adaptive Grasshopper Optimization (AGHO) algorithm is applied to fine-tune the parameters of the MobileNet model, thereby enhancing its performance and accuracy. Finally, the Fusion Module integrates outputs from local modules into a unified, realistic sketch. The proposed method achieved an accuracy of 96.82% on the CUHK dataset, 97.12% on the AR dataset, 98.84% on the XM2VTS dataset, and 98.62% on the CUFSF dataset, demonstrating its effectiveness across diverse benchmarks.

International Journal of Image and Graphics
Koneru Lakshmaiah Education Foundation (IN)
Openalex Percentile: Top 66%
Face recognition and analysis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.