XDAC: XAI-Driven Detection and Attribution of LLM-Generated News Comments in Korean
Large language models (LLMs) generate human-like text, raising concerns about their misuse in creating deceptive content.Detecting LLM-generated comments (LGC) in online news is essential for preserving online discourse integrity and preventing opinion manipulation.However, effective detection faces two key challenges: the brevity and informality of news comments limit traditional detection methods, while the lack of publicly available LGC datasets hinders model development, particularly for non-English languages.To address these challenges, we propose a twofold approach.First, we develop an LGC generation framework to construct a high-quality dataset with diverse and complex examples.Second, we introduce XDAC (XAI-Driven Detection and Attribution of LLM-Generated Comments), a framework utilizing explainable AI, designed for the detection and attribution of short-form LGC in Korean news articles.XDAC leverages XAI to uncover distinguishing linguistic patterns at both token and character levels.We present the first large-scale benchmark dataset, comprising 1.3M human-written comments from Korean news platforms and 1M LLM-generated comments from 14 distinct models.XDAC outperforms existing methods, achieving a 98.5% F1 score in LGC detection with a relative improvement of 68.1%, and an 84.3% F1 score in attribution.To validate real-world applicability, we analyze 5.24M news comments from Naver, South Korea's leading online news platform, identifying 27,029 potential LLM-generated comments.
Authors
- Hyoungshick Kim (ORCID: https://orcid.org/0000-0002-1605-3866)
- Wooyoung Go
- Alice Oh (ORCID: https://orcid.org/0000-0002-7884-3038)
- Yongdae Kim (ORCID: https://orcid.org/0000-0003-4879-1262)
Publication Details
- Published
- 2025-01-01
- DOI
- https://doi.org/10.18653/v1/2025.acl-long.1108
- Primary Topic
- Natural Language Processing Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Institute for Information and Communications Technology Promotion