Dynamic Attention-Guided Video Generation from Text with Multi-Scale Synthesis and LoRA Optimization

This paper introduces DAG-VSNet, a new architecture for high-quality text-to-video generation. The model uses a Dynamic Text Encoder (DTE), Multi-Scale Video Generator (MS-VG), Dynamic Attention Map (DAM), and LoRA-Enhanced Video Generator (LVG). The DTE captures temporal patterns, and the DAM helps focus on important text features. The MS-VG improves video details at different scales, and the LVG fine-tunes pre-trained weights with less computation. Experiments show DAG-VSNet works better than baseline models in metrics like Inception Score (IS), Fréchet Inception Distance (FID), Temporal Consistency Score (TCS), and Text-Video Alignment Score (TVAS). Ablation studies show that LoRA, dynamic attention, and multi-scale methods improve performance. This work provides a useful framework for future research in text-driven video generation.

Authors

Institutions

Publication Details

Published
2025-03-21
DOI
https://doi.org/10.1109/iscait64916.2025.11010506
Citations
1
Primary Topic
Video Analysis and Summarization
Type
article
Field-Weighted Citation Impact
1.28
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Dynamic Attention-Guided Video Generation from Text with Multi-Scale Synthesis and LoRA Optimization

Jiangtian Pan, Han Wu, Shicheng Zhou, Ruijie Zhu et al.
1 citations
Video Analysis and Summarization
1.28
article

Dynamic Attention-Guided Video Generation from Text with Multi-Scale Synthesis and LoRA Optimization

Jiangtian Pan, Han Wu, Shicheng Zhou, Ruijie Zhu, Yuan Gao, Hanlu Zhang
article en
1 citations

Abstract

This paper introduces DAG-VSNet, a new architecture for high-quality text-to-video generation. The model uses a Dynamic Text Encoder (DTE), Multi-Scale Video Generator (MS-VG), Dynamic Attention Map (DAM), and LoRA-Enhanced Video Generator (LVG). The DTE captures temporal patterns, and the DAM helps focus on important text features. The MS-VG improves video details at different scales, and the LVG fine-tunes pre-trained weights with less computation. Experiments show DAG-VSNet works better than baseline models in metrics like Inception Score (IS), Fréchet Inception Distance (FID), Temporal Consistency Score (TCS), and Text-Video Alignment Score (TVAS). Ablation studies show that LoRA, dynamic attention, and multi-scale methods improve performance. This work provides a useful framework for future research in text-driven video generation.

Stevens Institute of Technology (US), University of Minnesota (US), University of Wisconsin–Madison (US), Wuhan University (CN)
Openalex Percentile: Top 20%
Video Analysis and Summarization
1.28
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.