LLMTaxo: Leveraging Large Language Models for Constructing Taxonomy of Factual Claims from Social Media

With the rapid expansion of content on social media platforms, analyzing and comprehending online discourse has become increasingly complex.This paper introduces LLMTaxo, a novel framework leveraging large language models for the automated construction of taxonomies of factual claims from social media by generating topics at multiple levels of granularity.The resulting hierarchical structure significantly reduces redundancy and improves information accessibility.We also propose dedicated taxonomy evaluation metrics to enable comprehensive assessment.Evaluations conducted on three diverse datasets demonstrate LLMTaxo's effectiveness in producing clear, coherent, and comprehensive taxonomies.Among the evaluated models, GPT-4o mini consistently outperforms others across most metrics.The framework's flexibility and low reliance on manual intervention underscore its potential for broad applicability.

Authors

Institutions

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.findings-acl.1007
Citations
2
Primary Topic
Artificial Intelligence in Law
Type
article
Field-Weighted Citation Impact
17.04

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

LLMTaxo: Leveraging Large Language Models for Constructing Taxonomy of Factual Claims from Social Media

Zhengyuan Zhu, Haiqi Zhang, Chengkai Li, Zeyu Zhang
2 citations
Artificial Intelligence in Law
17.04
article

LLMTaxo: Leveraging Large Language Models for Constructing Taxonomy of Factual Claims from Social Media

Zhengyuan Zhu, Haiqi Zhang, Chengkai Li, Zeyu Zhang
article en
2 citations

Abstract

With the rapid expansion of content on social media platforms, analyzing and comprehending online discourse has become increasingly complex.This paper introduces LLMTaxo, a novel framework leveraging large language models for the automated construction of taxonomies of factual claims from social media by generating topics at multiple levels of granularity.The resulting hierarchical structure significantly reduces redundancy and improves information accessibility.We also propose dedicated taxonomy evaluation metrics to enable comprehensive assessment.Evaluations conducted on three diverse datasets demonstrate LLMTaxo's effectiveness in producing clear, coherent, and comprehensive taxonomies.Among the evaluated models, GPT-4o mini consistently outperforms others across most metrics.The framework's flexibility and low reliance on manual intervention underscore its potential for broad applicability.

The University of Texas at Arlington (US)
National Science Foundation
Reduced inequalities
Openalex Percentile: Top 1%
Artificial Intelligence in Law
17.04
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

LLMTaxo: Leveraging Large Language Models for Constructing Taxonomy of Factual Claims from Social Media — Zhengyuan Zhu, Haiqi Zhang, et al. · (2025) | TGRS Research Map | TGRS