Research on short video content recognition and recommendation algorithm based on deep learning

This paper discusses the method of short video content recognition and personalized recommendation by using deep learning technology. Different from traditional behavior recognition techniques, deep learning shows its strong ability in feature extraction, which can automatically learn adaptive and highly distinguishable features. First of all, considering the dual properties of time and space of video content, this paper adopts deep learning model to extract spatial and temporal features of video respectively, and combines them to form spatiotemporal fusion features. A video behavior recognition algorithm based on spatiotemporal convolutional network is designed to process video behavior recognition as the acquisition of spatial and temporal information of video. Based on the two-flow convolutional network, the effects of optical flow image and salience image on behavior recognition are compared and analyzed. On this basis, the attention mechanism inspired by the human visual system is introduced, and the space-time fusion model based on the attention mechanism is constructed. By assigning higher weights to key frames in video clips, the model focuses more on the important parts of the video, thus reducing the impact of redundant information on behavior analysis. Finally, the reliability of the model is verified on a real world data set.

Authors

Institutions

Publication Details

Published
2024-12-29
DOI
https://doi.org/10.1109/iceace63551.2024.10898846
Primary Topic
Ideological and Political Education
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Research on short video content recognition and recommendation algorithm based on deep learning

Lin Tongxi, Cai Yuying
Ideological and Political Education
article

Research on short video content recognition and recommendation algorithm based on deep learning

Lin Tongxi, Cai Yuying
article en

Abstract

This paper discusses the method of short video content recognition and personalized recommendation by using deep learning technology. Different from traditional behavior recognition techniques, deep learning shows its strong ability in feature extraction, which can automatically learn adaptive and highly distinguishable features. First of all, considering the dual properties of time and space of video content, this paper adopts deep learning model to extract spatial and temporal features of video respectively, and combines them to form spatiotemporal fusion features. A video behavior recognition algorithm based on spatiotemporal convolutional network is designed to process video behavior recognition as the acquisition of spatial and temporal information of video. Based on the two-flow convolutional network, the effects of optical flow image and salience image on behavior recognition are compared and analyzed. On this basis, the attention mechanism inspired by the human visual system is introduced, and the space-time fusion model based on the attention mechanism is constructed. By assigning higher weights to key frames in video clips, the model focuses more on the important parts of the video, thus reducing the impact of redundant information on behavior analysis. Finally, the reliability of the model is verified on a real world data set.

Guangzhou Vocational College of Science and Technology (CN)
Openalex Percentile: Top 61%
Ideological and Political Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.