GLCViT: A Multiscale Visual Transformer Framework for Hotspot Prediction in Film and Television Dissemination
Traditional hotspot prediction methods, which rely on statistical features or shallow neural networks, often fail to effectively capture the complex temporal dynamics and semantic evolution inherent in this context. To address this challenge, this paper proposes a hierarchical temporal feature extraction framework designed to accommodate both long-term trends and short-term surges in hotspot propagation. This framework integrates a Hidden Markov Model with dynamic texture modeling and enhances the representation of nonlinear dynamic patterns through a segmented linear approximation strategy. Furthermore, to overcome the computational limitations of traditional Vision Transformers (ViTs) in resource-constrained environments, a hierarchical attention mechanism combined with an attention pooling strategy is introduced, along with a dual-scale input pathway. Building on these innovations, the paper presents the Global-Local Context Vision Transformer (GLCViT) module, which synergistically incorporates windowed attention and a multi-scale depthwise separable convolutional structure to effectively model global semantic dependencies across cameras and fine-grained boundary features within a single camera. Experimental results demonstrate that the proposed model achieves notable performance improvements on the MovieNet and ViralVideos-50K datasets, reducing the prediction error for propagation breaking points to just 0.5 hours and achieving a prediction accuracy of nearly 95%. The proposed architecture not only enhances prediction accuracy and accelerates training convergence but also confirms the viability and scalability of the ViT framework for modeling the propagation of film and television content, thereby offering technical support for the development of efficient and interpretable hotspot prediction systems.
Authors
- Jingrui Li (ORCID: https://orcid.org/0000-0003-0348-068X)
- Haoran Li (ORCID: https://orcid.org/0009-0008-4848-336X)
Institutions
- Kennedy Krieger Institute (US)
- Johns Hopkins University (US)
- Shanghai University of Sport (CN)
- Johns Hopkins Medicine (US)
Publication Details
- Journal
- IEEE Access
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1109/access.2025.3627563
- Primary Topic
- Image and Video Quality Assessment
- Type
- article
- Field-Weighted Citation Impact
- 0.00