Video Summarization using 3D CNNs: A Convolutional Approach to Spatial-Temporal Feature Extraction

The advancement of videos has been accelerating quite fast and needs efficient summarization mechanisms. The proposed approach in this work is an unsupervised framework with an efficient combination of spatiotemporal transformers and dual-path attention-based networks, yielding more accurate summaries using multimodal inputs, namely Visual, Audio, and Text. By employing a more robust attention mechanism like AoA, one is ensured of keyframe selection that is precise and maintains aesthetics and narrative coherence. It achieves personalization based on clustering-based keyframe extraction and an adaptive user preference that does not require annotated datasets. Our scalable summary achieves better F1-scores than existing deep learning methods and also resolves video-length dependency problems of the reference works. It also balances summation brevity, visual quality, and narrative fidelity while maintaining applicability to video sub-genres. Comprehensive experiments on SumMe and TVSum showed the model renders high-quality and scalable video summaries, providing a reasonable baseline for large-scale video decoding applications. Index Terms—Video summarization, Convolutional Neural Networks, Kaiming Initialization, spatial-temporal feature extraction, Binary Cross- Entropy Loss.

Authors

Institutions

Publication Details

Published
2025-03-06
DOI
https://doi.org/10.1109/icoeca66273.2025.00148
Citations
2
Primary Topic
Generative Adversarial Networks and Image Synthesis
Type
article
Field-Weighted Citation Impact
2.55
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Video Summarization using 3D CNNs: A Convolutional Approach to Spatial-Temporal Feature Extraction

Kanendra Naidu, Pusarla Sindhu, Pamidisetti Kushwanth, Gantasala Tanooj Vardhan et al.
2 citations
Generative Adversarial Networks and Image Synthesis
2.55
article

Video Summarization using 3D CNNs: A Convolutional Approach to Spatial-Temporal Feature Extraction

Kanendra Naidu, Pusarla Sindhu, Pamidisetti Kushwanth, Gantasala Tanooj Vardhan, Vadlamudi Manvitha
article en
2 citations

Abstract

The advancement of videos has been accelerating quite fast and needs efficient summarization mechanisms. The proposed approach in this work is an unsupervised framework with an efficient combination of spatiotemporal transformers and dual-path attention-based networks, yielding more accurate summaries using multimodal inputs, namely Visual, Audio, and Text. By employing a more robust attention mechanism like AoA, one is ensured of keyframe selection that is precise and maintains aesthetics and narrative coherence. It achieves personalization based on clustering-based keyframe extraction and an adaptive user preference that does not require annotated datasets. Our scalable summary achieves better F1-scores than existing deep learning methods and also resolves video-length dependency problems of the reference works. It also balances summation brevity, visual quality, and narrative fidelity while maintaining applicability to video sub-genres. Comprehensive experiments on SumMe and TVSum showed the model renders high-quality and scalable video summaries, providing a reasonable baseline for large-scale video decoding applications. Index Terms—Video summarization, Convolutional Neural Networks, Kaiming Initialization, spatial-temporal feature extraction, Binary Cross- Entropy Loss.

GITAM University (IN)
Openalex Percentile: Top 9%
Generative Adversarial Networks and Image Synthesis
2.55
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.