Zero-shot Micro-video Classification with Dual Alignment Topic Model

In the current digital media environment, micro-video platforms such as TikTok and Kuaishou have become major channels for content consumption and social interaction. Micro-video classification is crucial for the performance of personalized recommendation systems. However, traditional micro-video classification methods rely on a large amount of labeled data, making it challenging to handle the dynamic emergence of new categories and topics. Therefore, zero-shot micro-video classification has become an important research topic. This paper proposes a Dual Alignment Topic Model (DATM) model that achieves knowledge transfer from known categories to unknown categories through dual topic mining and alignment constraints. Specifically, we use a pre-trained language model to generate word embeddings for class semantic descriptions (CSD) and perform topic modeling on both videos and CSDs. By employing distribution alignment and reconstruction alignment constraints, we effectively mitigate the transfer problem between videos and CSDs. Extensive experiments on real-world industrial datasets validate the effectiveness of our model, significantly improving the performance of zero-shot micro-video classification.

Authors

Institutions

Publication Details

Published
2025-03-12
DOI
https://doi.org/10.1109/icassp49660.2025.10889199
Primary Topic
Video Analysis and Summarization
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Zero-shot Micro-video Classification with Dual Alignment Topic Model

Jialong Wang, Zhiguo Gong, Shilong Zhang
Video Analysis and Summarization
article

Zero-shot Micro-video Classification with Dual Alignment Topic Model

Jialong Wang, Zhiguo Gong, Shilong Zhang
article en

Abstract

In the current digital media environment, micro-video platforms such as TikTok and Kuaishou have become major channels for content consumption and social interaction. Micro-video classification is crucial for the performance of personalized recommendation systems. However, traditional micro-video classification methods rely on a large amount of labeled data, making it challenging to handle the dynamic emergence of new categories and topics. Therefore, zero-shot micro-video classification has become an important research topic. This paper proposes a Dual Alignment Topic Model (DATM) model that achieves knowledge transfer from known categories to unknown categories through dual topic mining and alignment constraints. Specifically, we use a pre-trained language model to generate word embeddings for class semantic descriptions (CSD) and perform topic modeling on both videos and CSDs. By employing distribution alignment and reconstruction alignment constraints, we effectively mitigate the transfer problem between videos and CSDs. Extensive experiments on real-world industrial datasets validate the effectiveness of our model, significantly improving the performance of zero-shot micro-video classification.

University of Macau (MO), City University of Macau (MO)
Science and Technology Development Fund
Openalex Percentile: Top 97%
Video Analysis and Summarization
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Zero-shot Micro-video Classification with Dual Alignment Topic Model — Jialong Wang, Zhiguo Gong, et al. · (2025) | TGRS Research Map | TGRS