Generating Sketch Faces from Text Descriptions: Dataset and Algorithm

Sketching, as a form of painting, is widely used to pursue fugitives. The main method of modern criminal investigation sketching is for artists to sketch suspects' faces based on witness descriptions. However, to ensure that the sketches match the witness descriptions, the artists must possess both professional expertise and a substantial reservoir of experience. The process is inherently time-consuming. As a consequence of developments in the field of generative adversarial networks, it is possible to quickly generate corresponding sketch face images from text descriptions. However, this research is challenging due to two facts: first, there is no available dataset of face attribute text to sketches; second, due to the abstractness and simplicity of sketch images, it is difficult to synthesize high-quality face sketches. In this study, our contributions are twofold: 1) We propose a novel text-to-sketch face network, MDPGAN. 2) We build a comprehensive dataset, CelebASketch-HQ, which contains high-quality face sketch images, each accompanied by ten corresponding text descriptions. Finally, experimental evidence substantiates the efficacy of our approach.

Authors

Institutions

Publication Details

Published
2024-11-01
DOI
https://doi.org/10.1109/asid63618.2024.10839706
Citations
1
Primary Topic
Handwritten Text Recognition Techniques
Type
article
Field-Weighted Citation Impact
0.25
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Generating Sketch Faces from Text Descriptions: Dataset and Algorithm

Qibing Zhu, Lifen Weng, J. Guo
1 citations
Handwritten Text Recognition Techniques
0.25
article

Generating Sketch Faces from Text Descriptions: Dataset and Algorithm

Qibing Zhu, Lifen Weng, J. Guo
article en
1 citations

Abstract

Sketching, as a form of painting, is widely used to pursue fugitives. The main method of modern criminal investigation sketching is for artists to sketch suspects' faces based on witness descriptions. However, to ensure that the sketches match the witness descriptions, the artists must possess both professional expertise and a substantial reservoir of experience. The process is inherently time-consuming. As a consequence of developments in the field of generative adversarial networks, it is possible to quickly generate corresponding sketch face images from text descriptions. However, this research is challenging due to two facts: first, there is no available dataset of face attribute text to sketches; second, due to the abstractness and simplicity of sketch images, it is difficult to synthesize high-quality face sketches. In this study, our contributions are twofold: 1) We propose a novel text-to-sketch face network, MDPGAN. 2) We build a comprehensive dataset, CelebASketch-HQ, which contains high-quality face sketch images, each accompanied by ten corresponding text descriptions. Finally, experimental evidence substantiates the efficacy of our approach.

Xiamen University of Technology (CN)
Openalex Percentile: Top 42%
Handwritten Text Recognition Techniques
0.25
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.