SYNCVISION: High-Resolution Speech-Synchronized Portrait Animation Using Conditional Generative Adversarial Networks
SYNCVISION is a deep learning-based system designed to generate high-resolution speech-synced portrait animations. By utilizing the pretrained Wav2Lip model, it aligns lip movements in portrait images with corresponding audio input, ensuring high-quality animations with computational efficiency. The system is optimized to handle various accents, languages, and visual contexts, making it versatile across different scenarios. SYNCVISION is evaluated using metrics like Mean Absolute Error (MAE) and Lip Synchronization Error (LSE), as well as subjective quality assessments. This project aims to provide a scalable solution for creating realistic speech-driven animations in applications like entertainment, education, and virtual communication.
Authors
- P M Soumya
- N G Devaki
- B. Srinivasulu (ORCID: https://orcid.org/0000-0002-4074-0017)
- R. Harini
- R. Hyndhavi
Publication Details
- Published
- 2025-03-07
- DOI
- https://doi.org/10.1109/csnt64827.2025.10967943
- Primary Topic
- Speech and Audio Processing
- Type
- article
- Field-Weighted Citation Impact
- 0.00