Future Frame Prediction Using a U-Net-Based Wasserstein Generative Adversarial Network (WGAN) Approach

This paper presents a novel approach to activity prediction using Generative Adversarial Networks (GANs). Activity prediction plays a crucial role in applications such as surveillance and human-computer interaction. Previous works in activity prediction have struggled with long-term predictions and have primarily relied on skeleton data, which lack rich visual context and fine-grained motion details. To address these challenges, we propose a GAN-based model that predicts future frames by learning complex motion dynamics, overcoming the limitations of relying solely on skeleton data. The proposed model is evaluated on two benchmark datasets, UT-Interaction and UCF11, using two evaluation metrics: Mean Squared Error (MSE) and Structural Similarity Index (SSIM). We also analyze the model’s performance with different loss functions, demonstrating its efficacy. The results indicate significant improvements in prediction accuracy compared to existing methods. Future work will explore alternative algorithms to better capture temporal dependencies and consider additional datasets to improve prediction accuracy and robustness in real-world applications.

Authors

Institutions

Publication Details

Published
2025-03-06
DOI
https://doi.org/10.1109/rait65068.2025.11089203
Primary Topic
Image Processing and 3D Reconstruction
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Future Frame Prediction Using a U-Net-Based Wasserstein Generative Adversarial Network (WGAN) Approach

Upasna Singh, Ajay Waghumbare, Eshandeep Singh Grewal
1 links
Image Processing and 3D Reconstruction
article

Future Frame Prediction Using a U-Net-Based Wasserstein Generative Adversarial Network (WGAN) Approach

Upasna Singh, Ajay Waghumbare, Eshandeep Singh Grewal
article en

Abstract

This paper presents a novel approach to activity prediction using Generative Adversarial Networks (GANs). Activity prediction plays a crucial role in applications such as surveillance and human-computer interaction. Previous works in activity prediction have struggled with long-term predictions and have primarily relied on skeleton data, which lack rich visual context and fine-grained motion details. To address these challenges, we propose a GAN-based model that predicts future frames by learning complex motion dynamics, overcoming the limitations of relying solely on skeleton data. The proposed model is evaluated on two benchmark datasets, UT-Interaction and UCF11, using two evaluation metrics: Mean Squared Error (MSE) and Structural Similarity Index (SSIM). We also analyze the model’s performance with different loss functions, demonstrating its efficacy. The results indicate significant improvements in prediction accuracy compared to existing methods. Future work will explore alternative algorithms to better capture temporal dependencies and consider additional datasets to improve prediction accuracy and robustness in real-world applications.

Defence Institute of Advanced Technology (IN), Guru Teg Bahadur Hospital (IN)
Openalex Percentile: Top 83%
Image Processing and 3D Reconstruction
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.