DETECTION METHOD LANGUAGE AND PLATFORM CHARACTERISTICS PREDICT MACHINE GENERATED TEXT IDENTIFICATION ACROSS MULTILINGUAL SOCIAL PLATFORMS

This analysis examines whether detector rankings remain consistent across multilingual social media environments when evaluation coverage is standardized. A descriptive secondary analysis uses 1,032 published Multi Social evaluations from 2025, covering twelve detectors, twenty-two languages and five platforms. Comparisons summarize AUROC distributions and match detector, language and platform groups. Configurations adapted to Multi Social achieve mean AUROC of 0.9622, compared with 0.5470 for previously trained alternatives, with higher family averages in all 86 common evaluation combinations. Across nine languages with complete platform coverage, the spread in language means narrows from 0.2116 among previously trained configurations to 0.0171 among adapted configurations. Platform ordering also changes: Telegram leads unrestricted comparisons, whereas Discord leads after matching language coverage. This reversal demonstrates how evaluation composition shapes aggregate rankings without changing underlying scores. The analysis refines the descriptive application of domain adaptation reasoning by distinguishing consistent configuration advantages from composition sensitive comparisons. Detector procurement and governance should require matched evaluations and documented linguistic coverage before translating pooled benchmark rankings into operational decisions.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-11-07
DOI
https://doi.org/10.5281/zenodo.24041536
Primary Topic
Authorship Attribution and Profiling
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

DETECTION METHOD LANGUAGE AND PLATFORM CHARACTERISTICS PREDICT MACHINE GENERATED TEXT IDENTIFICATION ACROSS MULTILINGUAL SOCIAL PLATFORMS

Divya Vishwanath & Paul Johnson Asamoah
1 links
Zenodo (CERN European Organization for Nuclear Research)
Authorship Attribution and Profiling
article

DETECTION METHOD LANGUAGE AND PLATFORM CHARACTERISTICS PREDICT MACHINE GENERATED TEXT IDENTIFICATION ACROSS MULTILINGUAL SOCIAL PLATFORMS

Divya Vishwanath & Paul Johnson Asamoah
article en

Abstract

This analysis examines whether detector rankings remain consistent across multilingual social media environments when evaluation coverage is standardized. A descriptive secondary analysis uses 1,032 published Multi Social evaluations from 2025, covering twelve detectors, twenty-two languages and five platforms. Comparisons summarize AUROC distributions and match detector, language and platform groups. Configurations adapted to Multi Social achieve mean AUROC of 0.9622, compared with 0.5470 for previously trained alternatives, with higher family averages in all 86 common evaluation combinations. Across nine languages with complete platform coverage, the spread in language means narrows from 0.2116 among previously trained configurations to 0.0171 among adapted configurations. Platform ordering also changes: Telegram leads unrestricted comparisons, whereas Discord leads after matching language coverage. This reversal demonstrates how evaluation composition shapes aggregate rankings without changing underlying scores. The analysis refines the descriptive application of domain adaptation reasoning by distinguishing consistent configuration advantages from composition sensitive comparisons. Detector procurement and governance should require matched evaluations and documented linguistic coverage before translating pooled benchmark rankings into operational decisions.

Zenodo (CERN European Organization for Nuclear Research)
Openalex Percentile: Top 19%
Authorship Attribution and Profiling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon