LLMs as the Clustering Algorithm: A Cost-Quality-Interpretability Analysis of LLM-Direct Text Clustering

The standard pipeline for text clustering (embed, then run a geometric clustering algorithm) produces clusters that are accurate but opaque: a practitioner debugging the output sees anonymous centroids, not reasons. We study methods that use a large language model (LLM) as the entire clustering operator, and provide a controlled comparison of the natural inference topologies under one oracle abstraction: three base strategies, FullContext (the whole corpus in one call), ChunkMerge (parallel chunk clusterings unified by a prototype merge call), and Incremental (online, one assign-or-create call per item), plus a derived hybrid, SampleSeed (one call over a random seed sample, then parallel batch assignment against the frozen result). We derive each strategy's cost profile and measure quality, dollar cost, latency, order sensitivity, output reliability, and label interpretability against embedding baselines on four corpora. On noisy financial tweets the best cost-tier LLM configurations obtain mean ARI numerically comparable to the strongest embedding baseline (0.25-0.29 vs. 0.25, not significant on this fixed sample) at USD 0.02-0.65 per run; on a coarse control the outcome depends on who is told the true k, implicating granularity alignment as a central success factor. The clustering criterion is promptable: asked to cluster by sentiment instead of topic, the LLM reaches ARI 0.30 where generic embeddings stay at or below 0.08. FullContext degrades catastrophically with scale (over 2 output-repair events per item at N=1000), strategy rankings change across model tiers, and SampleSeed, sized by a coverage bound independent of corpus size, is the most scale-stable configuration at the cost tier, holding ARI 0.27 at N=1000 with a flat 10-25 second critical path. We quantify what each choice costs.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-08-25
DOI
https://doi.org/10.5281/zenodo.22101315
Primary Topic
Sentiment Analysis and Opinion Mining
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

LLMs as the Clustering Algorithm: A Cost-Quality-Interpretability Analysis of LLM-Direct Text Clustering

Sirui Ray Li
Zenodo (CERN European Organization for Nuclear Research)
Sentiment Analysis and Opinion Mining
preprint

LLMs as the Clustering Algorithm: A Cost-Quality-Interpretability Analysis of LLM-Direct Text Clustering

Sirui Ray Li
preprint en

Abstract

The standard pipeline for text clustering (embed, then run a geometric clustering algorithm) produces clusters that are accurate but opaque: a practitioner debugging the output sees anonymous centroids, not reasons. We study methods that use a large language model (LLM) as the entire clustering operator, and provide a controlled comparison of the natural inference topologies under one oracle abstraction: three base strategies, FullContext (the whole corpus in one call), ChunkMerge (parallel chunk clusterings unified by a prototype merge call), and Incremental (online, one assign-or-create call per item), plus a derived hybrid, SampleSeed (one call over a random seed sample, then parallel batch assignment against the frozen result). We derive each strategy's cost profile and measure quality, dollar cost, latency, order sensitivity, output reliability, and label interpretability against embedding baselines on four corpora. On noisy financial tweets the best cost-tier LLM configurations obtain mean ARI numerically comparable to the strongest embedding baseline (0.25-0.29 vs. 0.25, not significant on this fixed sample) at USD 0.02-0.65 per run; on a coarse control the outcome depends on who is told the true k, implicating granularity alignment as a central success factor. The clustering criterion is promptable: asked to cluster by sentiment instead of topic, the LLM reaches ARI 0.30 where generic embeddings stay at or below 0.08. FullContext degrades catastrophically with scale (over 2 output-repair events per item at N=1000), strategy rankings change across model tiers, and SampleSeed, sized by a coverage bound independent of corpus size, is the most scale-stable configuration at the cost tier, holding ARI 0.27 at N=1000 with a flat 10-25 second critical path. We quantify what each choice costs.

Zenodo (CERN European Organization for Nuclear Research)
Sentiment Analysis and Opinion Mining
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

LLMs as the Clustering Algorithm: A Cost-Quality-Interpretability Analysis of LLM-Direct Text Clustering — Sirui Ray Li · Zenodo (CERN European Organization for Nuclear Research) (2026) | TGRS Research Map | TGRS