Animate Sketch: Text-Driven Sketch Animation Generation

Sketches represent a significant form of human visual expression. During the animation process, key frames and draft animations are indispensable components. However, this production process is time-consuming and demanding, requiring animator with substantial experience. In this paper, we propose an innovative algorithm that animates sketches based on the input text prompt. Concretely, the sketches are represented using Bezier curves, and the output is a vector sketch animation. Our model guides the placement of strokes with an optimized score distillation sampling (SDS) method based on a large pretrained text-to-video diffusion model. Moreover, the model incorporates geometric and semantic simplifications in its generation process. The results demonstrate that the sketch animations produced by our method yield favorable outcomes.

Authors

Institutions

Publication Details

Published
2024-12-13
DOI
https://doi.org/10.1109/icftic64248.2024.10913167
Primary Topic
Human Motion and Animation
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Animate Sketch: Text-Driven Sketch Animation Generation

Zhuoyun Liu, Xueming Li
Human Motion and Animation
article

Animate Sketch: Text-Driven Sketch Animation Generation

Zhuoyun Liu, Xueming Li
article en

Abstract

Sketches represent a significant form of human visual expression. During the animation process, key frames and draft animations are indispensable components. However, this production process is time-consuming and demanding, requiring animator with substantial experience. In this paper, we propose an innovative algorithm that animates sketches based on the input text prompt. Concretely, the sketches are represented using Bezier curves, and the output is a vector sketch animation. Our model guides the placement of strokes with an optimized score distillation sampling (SDS) method based on a large pretrained text-to-video diffusion model. Moreover, the model incorporates geometric and semantic simplifications in its generation process. The results demonstrate that the sketch animations produced by our method yield favorable outcomes.

Beijing University of Posts and Telecommunications (CN)
Openalex Percentile: Top 65%
Human Motion and Animation
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.