Out-of-Distribution Detection via LLM-Guided Outlier Generation for Text-attributed Graph

Text-Attributed Graphs (TAGs), which are characterized with text attributes, are widely used in the real world.When evaluating fully trained models designed for TAG predictions, they may perform significantly unsatisfactory on samples outside the In-Distribution (ID) data, which may raise serious security issues.To tackle it, Out-Of-Distribution (OOD) detection is introduced to the TAGs field, which aims to utilize a detector to classify OOD and ID samples.Recent studies attempt to introduce extra OOD datasets to regularize the detection model.However, due to the vastness of the OOD data space, high-quality OOD samples for training the detector are scarce and difficult to obtain in the real world.Thus, we utilize Large Language Models (LLMs) to generate the OOD training samples with high quality.There are two issues in this process: (1) LLMs tend to generate OOD nodes noticeably distinct from ID nodes, with a limited learning value for OOD and ID relations.(2) Due to the inherent structure of TAGs, obtained OOD nodes need to be integrated with existing nodes by generating edges using LLMs.However, the large number of nodes makes reasoning over each node pair computationally unbearable.Toward these issues, we introduce LLMGuard with challenging OOD-node generation and lightweight edge predictors.Extensive experiments prove the effectiveness of LLMGuard.The source code is available 1 .

Authors

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.findings-acl.1001
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Out-of-Distribution Detection via LLM-Guided Outlier Generation for Text-attributed Graph

Zhiang Dong, Beishui Liao, Sirui Han, Jingyuan Chen et al.
Topic Modeling
article

Out-of-Distribution Detection via LLM-Guided Outlier Generation for Text-attributed Graph

Zhiang Dong, Beishui Liao, Sirui Han, Jingyuan Chen, Mengze Li, Xiangwei Lv
article en

Abstract

Text-Attributed Graphs (TAGs), which are characterized with text attributes, are widely used in the real world.When evaluating fully trained models designed for TAG predictions, they may perform significantly unsatisfactory on samples outside the In-Distribution (ID) data, which may raise serious security issues.To tackle it, Out-Of-Distribution (OOD) detection is introduced to the TAGs field, which aims to utilize a detector to classify OOD and ID samples.Recent studies attempt to introduce extra OOD datasets to regularize the detection model.However, due to the vastness of the OOD data space, high-quality OOD samples for training the detector are scarce and difficult to obtain in the real world.Thus, we utilize Large Language Models (LLMs) to generate the OOD training samples with high quality.There are two issues in this process: (1) LLMs tend to generate OOD nodes noticeably distinct from ID nodes, with a limited learning value for OOD and ID relations.(2) Due to the inherent structure of TAGs, obtained OOD nodes need to be integrated with existing nodes by generating edges using LLMs.However, the large number of nodes makes reasoning over each node pair computationally unbearable.Toward these issues, we introduce LLMGuard with challenging OOD-node generation and lightweight edge predictors.Extensive experiments prove the effectiveness of LLMGuard.The source code is available 1 .

National Natural Science Foundation of China, National Key Research and Development Program of China
Openalex Percentile: Top 90%
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.