Encoder Mixing for Unsupervised Topic Discovery in Multi-Platform Chat: An Exploratory Study on Proxy Corpora

Seized-device chat dumps exceed manual review, and case-specific topic lists are not known in advance. We extend SCOPE (Semantic Coherence Pruning and Extraction), which embeds each message and each of 21 predefined topic labels with all-MiniLM-L12-v2; we replace that seed list with unsupervised discovery. The scored system is a six-stage pipeline. It cuts chat by embedding drift, clusters and names those segments, builds per-user topic timelines, and scores them against a per-message reference column. The baseline cell, minilm-l12-v2, is SCOPE’s encoder run through the frozen pipeline without the seed list. A 49-cell encoder grid is attempted on two corpora and three settings: a 66-message Sample walkthrough (4 topics); CrystalClear (917 messages, 7 rooms, 30 topics), the independent corpus; and a Dataset 3 coreset (2999 messages, 23 topics) whose rankings are provisional. Of those 49 cells, 37 score on all three, and none is first in all three. The CrystalClear semantic hand grid was marked by a large language model under a written rule, then it was revised once after a second model resolved open questions by reading sample messages carrying each reference label; five labels changed. No human checked individual marks. UAE-Large-V1 leads both evidential corpora, taking CrystalClear on the semantic hand grid (overall-F1 0.674) and the Dataset 3 coreset on auto p90 (macro-F1 0.593, provisional); a many-to-one definition-matching protocol reverses both rankings to MiniLM-L6. These are the observed results under the specific evaluation procedures described, not encoder rankings in general. A mix that stays first across matchers and settings remains an open limitation.

Authors

Institutions

Publication Details

Journal
Machine Learning and Knowledge Extraction
Published
2026-10-29
DOI
https://doi.org/10.3390/make8110359
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Encoder Mixing for Unsupervised Topic Discovery in Multi-Platform Chat: An Exploratory Study on Proxy Corpora

Pramesh Regmi, Gokila Dorai, Rajon Bardhan, Venkat Sumanth et al.
1 links
Machine Learning and Knowledge Extraction
Topic Modeling
article

Encoder Mixing for Unsupervised Topic Discovery in Multi-Platform Chat: An Exploratory Study on Proxy Corpora

Pramesh Regmi, Gokila Dorai, Rajon Bardhan, Venkat Sumanth, Piyush Kumar
article en

Abstract

Seized-device chat dumps exceed manual review, and case-specific topic lists are not known in advance. We extend SCOPE (Semantic Coherence Pruning and Extraction), which embeds each message and each of 21 predefined topic labels with all-MiniLM-L12-v2; we replace that seed list with unsupervised discovery. The scored system is a six-stage pipeline. It cuts chat by embedding drift, clusters and names those segments, builds per-user topic timelines, and scores them against a per-message reference column. The baseline cell, minilm-l12-v2, is SCOPE’s encoder run through the frozen pipeline without the seed list. A 49-cell encoder grid is attempted on two corpora and three settings: a 66-message Sample walkthrough (4 topics); CrystalClear (917 messages, 7 rooms, 30 topics), the independent corpus; and a Dataset 3 coreset (2999 messages, 23 topics) whose rankings are provisional. Of those 49 cells, 37 score on all three, and none is first in all three. The CrystalClear semantic hand grid was marked by a large language model under a written rule, then it was revised once after a second model resolved open questions by reading sample messages carrying each reference label; five labels changed. No human checked individual marks. UAE-Large-V1 leads both evidential corpora, taking CrystalClear on the semantic hand grid (overall-F1 0.674) and the Dataset 3 coreset on auto p90 (macro-F1 0.593, provisional); a many-to-one definition-matching protocol reverses both rankings to MiniLM-L6. These are the observed results under the specific evaluation procedures described, not encoder rankings in general. A mix that stays first across matchers and settings remains an open limitation.

Machine Learning and Knowledge ExtractionVol. 8(11)
Florida State University (US), Augusta University (US)
Openalex Percentile: Top 14%
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon