Comparing fine tuned embeddings and large language models for detecting multimodal online conspiracy theories

TikTok has skyrocketed in popularity over recent years, especially among younger audiences. However, there are public concerns about the potential of this platform to promote and amplify harmful content. This study presents a computational analysis of conspiracy theories on TikTok. By leveraging the official TikTok Research API we collect a longitudinal dataset of 1.5M videos shared by creators in the U.S. over three years. We estimate a lower bound on the prevalence of conspiratorial videos (up to 1000 new videos per month) and evaluate platform changes in association with TikTok’s Creativity Program for monetization, observing an overall increase in video duration regardless of content. In addition, we evaluate the capabilities of recent open-weight Large Language Models, both textual and multimodal, to identify conspiracy theories in short vertical format videos. While these models achieve high precision in detecting harmful content (up to $$98\%$$ ), their overall performance remains comparable to a fine-tuned traditional model such as RoBERTa. Our findings indicate that Large Language Models have the potential to support content moderation strategies on TikTok; however, their deployment involves trade-offs relative to fine-tuned traditional NLP approaches, particularly in terms of performance consistency.

Authors

Institutions

Publication Details

Journal
Discover Artificial Intelligence
Published
2026-11-19
DOI
https://doi.org/10.1007/s44163-026-02723-w
Primary Topic
Misinformation and Its Impacts
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Comparing fine tuned embeddings and large language models for detecting multimodal online conspiracy theories

Francesco Pierri, Carlo Alberto Bono, Gianmarco De Francisci Morales, F Corso
Discover Artificial Intelligence
Misinformation and Its Impacts
article

Comparing fine tuned embeddings and large language models for detecting multimodal online conspiracy theories

Francesco Pierri, Carlo Alberto Bono, Gianmarco De Francisci Morales, F Corso
article en

Abstract

TikTok has skyrocketed in popularity over recent years, especially among younger audiences. However, there are public concerns about the potential of this platform to promote and amplify harmful content. This study presents a computational analysis of conspiracy theories on TikTok. By leveraging the official TikTok Research API we collect a longitudinal dataset of 1.5M videos shared by creators in the U.S. over three years. We estimate a lower bound on the prevalence of conspiratorial videos (up to 1000 new videos per month) and evaluate platform changes in association with TikTok’s Creativity Program for monetization, observing an overall increase in video duration regardless of content. In addition, we evaluate the capabilities of recent open-weight Large Language Models, both textual and multimodal, to identify conspiracy theories in short vertical format videos. While these models achieve high precision in detecting harmful content (up to $$98\%$$ ), their overall performance remains comparable to a fine-tuned traditional model such as RoBERTa. Our findings indicate that Large Language Models have the potential to support content moderation strategies on TikTok; however, their deployment involves trade-offs relative to fine-tuned traditional NLP approaches, particularly in terms of performance consistency.

Discover Artificial IntelligenceVol. 6(1)
Intesa Sanpaolo (Italy) (IT), Intesa Sanpaolo Innovation Center (Italy) (IT), Politecnico di Milano (IT)
Misinformation and Its Impacts
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon