XDAC: XAI-Driven Detection and Attribution of LLM-Generated News Comments in Korean

Large language models (LLMs) generate human-like text, raising concerns about their misuse in creating deceptive content.Detecting LLM-generated comments (LGC) in online news is essential for preserving online discourse integrity and preventing opinion manipulation.However, effective detection faces two key challenges: the brevity and informality of news comments limit traditional detection methods, while the lack of publicly available LGC datasets hinders model development, particularly for non-English languages.To address these challenges, we propose a twofold approach.First, we develop an LGC generation framework to construct a high-quality dataset with diverse and complex examples.Second, we introduce XDAC (XAI-Driven Detection and Attribution of LLM-Generated Comments), a framework utilizing explainable AI, designed for the detection and attribution of short-form LGC in Korean news articles.XDAC leverages XAI to uncover distinguishing linguistic patterns at both token and character levels.We present the first large-scale benchmark dataset, comprising 1.3M human-written comments from Korean news platforms and 1M LLM-generated comments from 14 distinct models.XDAC outperforms existing methods, achieving a 98.5% F1 score in LGC detection with a relative improvement of 68.1%, and an 84.3% F1 score in attribution.To validate real-world applicability, we analyze 5.24M news comments from Naver, South Korea's leading online news platform, identifying 27,029 potential LLM-generated comments.

Authors

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.acl-long.1108
Primary Topic
Natural Language Processing Techniques
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

XDAC: XAI-Driven Detection and Attribution of LLM-Generated News Comments in Korean

Hyoungshick Kim, Wooyoung Go, Alice Oh, Yongdae Kim
Natural Language Processing Techniques
article

XDAC: XAI-Driven Detection and Attribution of LLM-Generated News Comments in Korean

Hyoungshick Kim, Wooyoung Go, Alice Oh, Yongdae Kim
article en

Abstract

Large language models (LLMs) generate human-like text, raising concerns about their misuse in creating deceptive content.Detecting LLM-generated comments (LGC) in online news is essential for preserving online discourse integrity and preventing opinion manipulation.However, effective detection faces two key challenges: the brevity and informality of news comments limit traditional detection methods, while the lack of publicly available LGC datasets hinders model development, particularly for non-English languages.To address these challenges, we propose a twofold approach.First, we develop an LGC generation framework to construct a high-quality dataset with diverse and complex examples.Second, we introduce XDAC (XAI-Driven Detection and Attribution of LLM-Generated Comments), a framework utilizing explainable AI, designed for the detection and attribution of short-form LGC in Korean news articles.XDAC leverages XAI to uncover distinguishing linguistic patterns at both token and character levels.We present the first large-scale benchmark dataset, comprising 1.3M human-written comments from Korean news platforms and 1M LLM-generated comments from 14 distinct models.XDAC outperforms existing methods, achieving a 98.5% F1 score in LGC detection with a relative improvement of 68.1%, and an 84.3% F1 score in attribution.To validate real-world applicability, we analyze 5.24M news comments from Naver, South Korea's leading online news platform, identifying 27,029 potential LLM-generated comments.

Institute for Information and Communications Technology Promotion
Openalex Percentile: Top 90%
Natural Language Processing Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.