Enhancing Generalization of Korean Deepfake Text Detection through Multi-Feature Fusion across Domain and Model Variations

Existing BERT-based deepfake text detection methods perform well when the training and test data domains are similar; however, their performance degrades significantly under domain shift. To address this limitation, this study proposes a fusion-feature-based deepfake text detection model designed to improve generalization performance in unseen environments.<br/> The proposed model integrates three complementary feature types: semantic features derived from BERT embeddings, token-level predictability features based on generation probability and rank statistics from language models, and surface-level stylometric features capturing structural characteristics of text. These heterogeneous features are combined into a unified fusion feature vector to enhance robustness against variations in both domain and text generation mechanisms.<br/> To evaluate generalization performance, two experimental settings are designed. First, a cross-domain evaluation is conducted by training and testing the model on different domains, specifically tourism review texts and youth employment related YouTube comments. Second, to examine the impact of generative model evolution, detection performance is compared using deepfake texts generated by GPT-2 and GPT-5.<br/> The experimental results show that the proposed fusion feature based detector maintains relatively stable performance under domain mismatch conditions, outperforming single-feature-based detectors. Furthermore, the fusion approach consistently demonstrates superior performance across different generative model settings, indicating its robustness to advancements in text generation models. These findings suggest that the proposed approach can effectively enhance the reliability of deepfake text detection in real-world applications, particularly in environments where domain variability and evolving generation models pose significant challenges.

Authors

Publication Details

Journal
The Journal of Internet Electronic Commerce Resarch
Published
2026-04-30
DOI
https://doi.org/10.37272/jiecr.2026.04.26.2.85
Primary Topic
Generative Adversarial Networks and Image Synthesis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Enhancing Generalization of Korean Deepfake Text Detection through Multi-Feature Fusion across Domain and Model Variations

Tharaka Sandun Gunasiri Baiya Dewayalage, Keunhyung Kim
The Journal of Internet Electronic Commerce Resarch
Generative Adversarial Networks and Image Synthesis
article

Enhancing Generalization of Korean Deepfake Text Detection through Multi-Feature Fusion across Domain and Model Variations

Tharaka Sandun Gunasiri Baiya Dewayalage, Keunhyung Kim
article en

Abstract

Existing BERT-based deepfake text detection methods perform well when the training and test data domains are similar; however, their performance degrades significantly under domain shift. To address this limitation, this study proposes a fusion-feature-based deepfake text detection model designed to improve generalization performance in unseen environments.<br/> The proposed model integrates three complementary feature types: semantic features derived from BERT embeddings, token-level predictability features based on generation probability and rank statistics from language models, and surface-level stylometric features capturing structural characteristics of text. These heterogeneous features are combined into a unified fusion feature vector to enhance robustness against variations in both domain and text generation mechanisms.<br/> To evaluate generalization performance, two experimental settings are designed. First, a cross-domain evaluation is conducted by training and testing the model on different domains, specifically tourism review texts and youth employment related YouTube comments. Second, to examine the impact of generative model evolution, detection performance is compared using deepfake texts generated by GPT-2 and GPT-5.<br/> The experimental results show that the proposed fusion feature based detector maintains relatively stable performance under domain mismatch conditions, outperforming single-feature-based detectors. Furthermore, the fusion approach consistently demonstrates superior performance across different generative model settings, indicating its robustness to advancements in text generation models. These findings suggest that the proposed approach can effectively enhance the reliability of deepfake text detection in real-world applications, particularly in environments where domain variability and evolving generation models pose significant challenges.

The Journal of Internet Electronic Commerce ResarchVol. 26(2)
Decent work and economic growth
Openalex Percentile: Top 4%
Generative Adversarial Networks and Image Synthesis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Enhancing Generalization of Korean Deepfake Text Detection through Multi-Feature Fusion across Domain and Model Variations — Tharaka Sandun Gunasiri Baiya Dewayalage, Keunhyung Kim · The Journal of Internet Electronic Commerce Resarch (2026) | TGRS Research Map | TGRS