From Sketch to Image: A GAN-Based Forensic Reconstruction System Using Text Prompts

Facial sketch-to-image synthesis is a crucial task in forensic investigations, digital art, and human-computer interaction. This research presents a Generative Adversarial Network (GAN)-based model that converts facial sketches into high-fidelity, photorealistic images guided by textual descriptions. The proposed approach integrates Contrastive Language-ImagePretraining (CLIP) to enhance textual feature extraction, ensuring detailed and accurate facial reconstructions. A refined encoder to StyleGAN pipeline is employed to generate images with structuralcoherenceand perceptual realism. The model is trainedon the Multi-Modal-CelebA-HQ dataset, comprising 19,923 paired sketches, images, and textual descriptions. Performance evaluationisconducted usingstandardimage similaritymetrics,includingL2Normand Structural Similarity Index (SSIM). Experimental results demonstrate that the proposed method achieves a highSSIMscore(0.788)andlowL2Norm(89.68),indicatingstrongstructuralsimilarityandfine-detail preservation. Despite promising results, limitations remain, such as the model's dependency on textual prompts, potential bias in generated features, and computational constraints. Future work will explore multi-modal enhancements, such as incorporating audio cues or additionalimage inputs, as well as adopting self-attention mechanisms and transformer-based architectures for improved image synthesis. This study contributes to advancements in AI-driven face reconstruction with applications in forensics, digital art, and entertainment industries

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2025-08-09
DOI
https://doi.org/10.5281/zenodo.16784406
Primary Topic
Generative Adversarial Networks and Image Synthesis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

From Sketch to Image: A GAN-Based Forensic Reconstruction System Using Text Prompts

Zenodo (CERN European Organization for Nuclear Research)
Generative Adversarial Networks and Image Synthesis
article

From Sketch to Image: A GAN-Based Forensic Reconstruction System Using Text Prompts

article en

Abstract

Facial sketch-to-image synthesis is a crucial task in forensic investigations, digital art, and human-computer interaction. This research presents a Generative Adversarial Network (GAN)-based model that converts facial sketches into high-fidelity, photorealistic images guided by textual descriptions. The proposed approach integrates Contrastive Language-ImagePretraining (CLIP) to enhance textual feature extraction, ensuring detailed and accurate facial reconstructions. A refined encoder to StyleGAN pipeline is employed to generate images with structuralcoherenceand perceptual realism. The model is trainedon the Multi-Modal-CelebA-HQ dataset, comprising 19,923 paired sketches, images, and textual descriptions. Performance evaluationisconducted usingstandardimage similaritymetrics,includingL2Normand Structural Similarity Index (SSIM). Experimental results demonstrate that the proposed method achieves a highSSIMscore(0.788)andlowL2Norm(89.68),indicatingstrongstructuralsimilarityandfine-detail preservation. Despite promising results, limitations remain, such as the model's dependency on textual prompts, potential bias in generated features, and computational constraints. Future work will explore multi-modal enhancements, such as incorporating audio cues or additionalimage inputs, as well as adopting self-attention mechanisms and transformer-based architectures for improved image synthesis. This study contributes to advancements in AI-driven face reconstruction with applications in forensics, digital art, and entertainment industries

Zenodo (CERN European Organization for Nuclear Research)
Openalex Percentile: Top 56%
Generative Adversarial Networks and Image Synthesis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.