Research on Film Advertisement Interaction Control Method Combining Deep Generative Models and Gesture Recognition

This paper proposes an interaction control method that integrates gesture recognition with conditional generative models to enhance the personalized responsiveness and user engagement of film advertisement systems. Traditional advertisement playback methods generally lack interactivity and are unable to dynamically adapt to user behavior. To address this issue, an end-to-end generative framework is constructed, mapping gesture recognition results into controllable generation signals, thereby enabling real-time linkage between user natural gestures and advertisement content. The system utilizes a Transformer-based dynamic gesture recognition model to extract semantic embeddings, which are then fed into a conditional generative adversarial network (cGAN) to produce advertisement keyframes aligned with user intent. A dynamic response-content synchronization mechanism is further incorporated to optimize system latency and responsiveness. Experimental results demonstrate that the proposed method outperforms conventional advertisement control systems in several critical aspects, including recognition accuracy, content generation quality, response speed, and user satisfaction. The average system response time is maintained under 200 milliseconds, and user satisfaction scores reach 4.6 out of 5, validating the system's significant improvement in interactivity and usability. The proposed system not only offers a unified framework for advertisement content generation and interaction control but also provides a new technical paradigm for the design and implementation of multimodal human-computer interaction systems.

Authors

Publication Details

Published
2025-06-06
DOI
https://doi.org/10.1145/3757749.3757822
Primary Topic
Human Pose and Action Recognition
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Research on Film Advertisement Interaction Control Method Combining Deep Generative Models and Gesture Recognition

Jiamin Qi, Chen Zhi-qian, Siqi Lei
Human Pose and Action Recognition
article

Research on Film Advertisement Interaction Control Method Combining Deep Generative Models and Gesture Recognition

Jiamin Qi, Chen Zhi-qian, Siqi Lei
article en

Abstract

This paper proposes an interaction control method that integrates gesture recognition with conditional generative models to enhance the personalized responsiveness and user engagement of film advertisement systems. Traditional advertisement playback methods generally lack interactivity and are unable to dynamically adapt to user behavior. To address this issue, an end-to-end generative framework is constructed, mapping gesture recognition results into controllable generation signals, thereby enabling real-time linkage between user natural gestures and advertisement content. The system utilizes a Transformer-based dynamic gesture recognition model to extract semantic embeddings, which are then fed into a conditional generative adversarial network (cGAN) to produce advertisement keyframes aligned with user intent. A dynamic response-content synchronization mechanism is further incorporated to optimize system latency and responsiveness. Experimental results demonstrate that the proposed method outperforms conventional advertisement control systems in several critical aspects, including recognition accuracy, content generation quality, response speed, and user satisfaction. The average system response time is maintained under 200 milliseconds, and user satisfaction scores reach 4.6 out of 5, validating the system's significant improvement in interactivity and usability. The proposed system not only offers a unified framework for advertisement content generation and interaction control but also provides a new technical paradigm for the design and implementation of multimodal human-computer interaction systems.

Openalex Percentile: Top 76%
Human Pose and Action Recognition
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Research on Film Advertisement Interaction Control Method Combining Deep Generative Models and Gesture Recognition — Jiamin Qi, Chen Zhi-qian, et al. · (2025) | TGRS Research Map | TGRS