Content Based Video Retrival System using RESNET-50

With the rapid increase in user-generated content and digital media, there is a growing need for intelligent systems that can understand and retrieve relevant video data based on both visual and textual queries. Traditional content-based video retrieval methods are often limited in handling complex semantic relationships and user intent. In this work, we propose a hybrid multimodal video retrieval framework that leverages deep learning techniques to bridge this gap. Our system combines visual feature extraction using a fine-tuned ResNet-50 model and semantic text embeddings derived from large language models like GPT-4 to enable more meaningful video classification and retrieval. To prepare the data, videos are preprocesses by extracting keyframes at regular intervals, resizing and normalizing them for uniform input, and storing them as tensors for efficient access. The classification model is trained and evaluated on the AID (Aerial Image Dataset), which offers diverse land-use categories, making it ideal for testing semantic understanding in complex scenes. Once labelled, videos are indexed using both visual and textual representations to support flexible and context-aware retrieval.Initial results show promising performance in recognizing high-level video concepts and returning contextually relevant content based on natural language prompts. This research showcases the potential of combining visual deep networks with language models to build intelligent, scalable video search systems suited for modern content platforms. Future work will focus on integrating personalization and real-time querying for broader applicability.

Authors

Publication Details

Journal
International Journal For Multidisciplinary Research
Published
2025-06-22
DOI
https://doi.org/10.36948/ijfmr.2025.v07i03.48875
Primary Topic
Video Analysis and Summarization
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Content Based Video Retrival System using RESNET-50

Arjun Aryal, Kruthika cg, Billakanti Mokshith, Rajeshwar Chaubey - et al.
International Journal For Multidisciplinary Research
Video Analysis and Summarization
article

Content Based Video Retrival System using RESNET-50

Arjun Aryal, Kruthika cg, Billakanti Mokshith, Rajeshwar Chaubey -, J - Sathvika
article en

Abstract

With the rapid increase in user-generated content and digital media, there is a growing need for intelligent systems that can understand and retrieve relevant video data based on both visual and textual queries. Traditional content-based video retrieval methods are often limited in handling complex semantic relationships and user intent. In this work, we propose a hybrid multimodal video retrieval framework that leverages deep learning techniques to bridge this gap. Our system combines visual feature extraction using a fine-tuned ResNet-50 model and semantic text embeddings derived from large language models like GPT-4 to enable more meaningful video classification and retrieval. To prepare the data, videos are preprocesses by extracting keyframes at regular intervals, resizing and normalizing them for uniform input, and storing them as tensors for efficient access. The classification model is trained and evaluated on the AID (Aerial Image Dataset), which offers diverse land-use categories, making it ideal for testing semantic understanding in complex scenes. Once labelled, videos are indexed using both visual and textual representations to support flexible and context-aware retrieval.Initial results show promising performance in recognizing high-level video concepts and returning contextually relevant content based on natural language prompts. This research showcases the potential of combining visual deep networks with language models to build intelligent, scalable video search systems suited for modern content platforms. Future work will focus on integrating personalization and real-time querying for broader applicability.

International Journal For Multidisciplinary ResearchVol. 7(3)
Openalex Percentile: Top 87%
Video Analysis and Summarization
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Content Based Video Retrival System using RESNET-50 — Arjun Aryal, Kruthika cg, et al. · International Journal For Multidisciplinary Research (2025) | TGRS Research Map | TGRS